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ABSTRACT 
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13-year-olds in the Second International Mathematics Study. The 
manual opens with overviews of the study and the databank and states 
th'^ purpose o£^ the training. In the second section on 
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are explained. The third section on ^'Application*' shows the general 
flow of processing to use the documentation and data files. Finally, 
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Appendices :>ertain to: (1) Analysis of the Cognitive Item Table; (2) 
International Item Response File; (3) U.S.A. Classroom Aggregate 
File; (4) Extracts from the Databank; and (5) Weighting and Sampling 
Errors. (MNS) 
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TRAINING MANUAL FOR USE OF THE DATABANK OF THE 
LONGITUDINAL, CLASSROOM PROCESS SURVEYS FOR 
POPULATION A IN THE lEA SECOND INTERNATIONAL 
MATHEMATICS STUDY 



Richard G. Wolfe 
The Ontario Institute for Studies in Education 



A. ORIENTATION 



Al . Overview of the Study 



The lEA Second International Mathematics Study (SIMS) was conducted in 20 
countries on two sampled populations: Population A of 13 year olds and Population 
B of students studying mathematics in their final year of secondary school. 
Mathematics achievement was measured with a large number of test items (180 or 
176 for the 13 year olds, 136 for the older students) distributed across the curricular 
content of mathematics found at :hese grade levels. In addition, a substantial 
amount of background information was collected from pupils, teachers, and 
schools, including detailed questions on the students' opportunity to learn the 
specific mathematics of the tests. 

For the 13 year old population, eight of the countries (Belgium Remish, Canada 
British Columbia, Canada Ontario, France, Japan, New Zealand, Thailand, and the 
United States) augmented the standard lEA-type survey design with two crucial 
innovations: (1) a pretest (beginning of school year) measure based on the same 
mathematics item pool and (2) rich documentation of classroom teaching practices. 
The survey instrumentation is shown in Figure 1. 

The subject of this training manual is the databank from the resulting longitudinal, 
classroom process surveys of Population A students, teachers, and schools. The 
dataseis and the potential analyses are unique: for the first time one has international 
datasets, gathered under common and rigorous survey conditions, with a pretest 
methodology that allows precise assessment of the specific mathematical content 
that is learned in a school year and with detailed information on the content and 
methodology of instruction. 



-1- 



6 



Population A: students 
in grade ith modal 
age of 13 years. Eight 
countries participating. 



Extensive classroom 
process questionnaires 



Fraciions 



Ritio, Proportion, 
Percent 



Algdn 



Geometry 



Measurement 

Gcnenl class- 
zoom pracdces 



School 

Organization 

Questionnaire 



Teacher 

Background 

Auitudes 

Teaching 

Practices 

Questionniare 

Each teacher 
indicated OIL 
for each of the 
180 items. 



Pretest and 
posttest... 



Core: 40 items) 



Rl: 35 items 
R2: 35 items 
R3: 35 items 
R4: 35 items 



Math Tests 



^Each student ^ 
answered the 
core and 1 
rotated form at 
the begining 
of the school 



Student 
Background 
Attitudes 
Questionnaire 



^lach student 
answered the 
core and 1 
rotated form at 
the end of the 
school year. 



FIGURE 1. Instrumentation for students, tvtachers-classrooms, and schools for 
the longitudinal, classroom process surveys at Population A 



A2. Overview of the Databank 



The databank comprises all the response data from the surveys in the eight 
participating countries together with a computerized version of all the corresponding 
data documentation. 

The databank is distributed on industry-standard magnetic computer tape as 39 files. 
The files arc all in standard ASCII (or EBCDIC) printable codes with record sizes of 
80 characters or less. 

The entire databank can also be stored in on-line disk, as it is on one of the 
VAXA^MS computers a: the Ontario Institute for Studies in Education. The data and 
data documentation files are organized in a set of directories as shown in Figure 2. 
The total disk storage in kilobytes is indicated 

In the main DATABANK directory can be found the DATALINK procedure, which 
makes the databank files easily accessible for inspection and analysis. For example, 
after invoking DATALINK, the student response data for New Zealand could be 
called into a statistical program simply as STUDENT:ALL.NZ. While this procedure 
is specific to VAXA^S computers, a similar arrangement can be made for other 
systems. Also in the main DATABANK directory are stored 4 demonstration 
programs and working files: LONGTAB.FOR, LONGTAB.OUT, COMBO.SPS, 
and COMBO.USA. These are described in section D of this manual and in 
Appendixes II and H. Finally, there is a file AAAREAD.ME, which contains 
last-minute update information about the databank. 

For each country, there are three response data files, corresponding to the data levels: 
SCHOOL, TEACHER or classroom, and STUDENT. These are given the name 
ALL plus a country code: ALL.BFL, ALL.BC, ALL.ONT, ALL.FRA, ALL.JPN, 
ALL.NZ, ALL.THA, ALL.USA. 

Each response file contains a fixed number of records per unit (e.g., per student). 
The first record contains the identification codes as well as keys that indicate the 
presence and completeness of the data (e.g., whether a student completed both pre 
and posttest questionnaires). The following records contain the original response 
data, laid out according to a simplified version of the international codebooks. The 
data for all questionnaires and tests, pre and post, are merged together. 

The computerized documentation files provide unified information about the data 
storage and coding, including the international standard systems as well as particular 
notes about the national variations, sampling designs, etc. 

There is one introductory file (A.O) and six main documentation files: (A.l) basic 
parameters and sizes, (A.2) definition of the response data layout, (A.3) cognitive 
item coding, (A.4) questionnaire item coding, (A.5) sampling notes and stratum 
definitions, and (A.6) detailed coding and textual explanations. 
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MAIN DIRECTORY (234 KB) 

DATALINK.CX)M: a command procedure 
to establish linkage to the databank. 

DOCUMENT.DIR, SCHOOL.DIR, 
TEACHER.DIR, STUDENfT.DIR: pointers 
to the documentation and data directories. 

LONGTAB.FOR, LONGTAB.OUT, 
COMBO.SPS, COMBO.USA: working 
files and demonstration programs. 

AAAREAD.ME: text file with last-minute 
update information about the databank. 



SCHOOL DIRECTORY (93 KB) 

ALL.BC, ALL.BFL, ALL.ONT, 
ALL.FRA, ALL.JPN, ALL.NZ, 
ALL.THA,ALL.USA: data files 



TEACHER DIRECTORY (3J92 KB) 

ALL.BC, ALL.BFL, ALL.ONT. 
ALL.FRA, ALL.JPN, ALL.NZ, 
ALL.THA,ALL.USA: data files 



STUDENT DIRECTORY (18 JOS KB) 

ALL.BC, ALL.BFL, ALL.ONT, 
ALL.FRA. ALL.JPN, ALL.NZ, 
ALL.THA, ALLUSA: data files 



DOCUMENT DIRECTORY 
(775 KB) 

A.Q: Introduction 
A.l: Basic parameters and 
sizes 

A.2: Response data layout 
A.3: Cognitive item coding 
A.4: Questionnaire item 

coding 
A.5: Sampling notes and 

strata definitions 
A.6: Detailed coding and 

textual explanations 
TABLE.COG: cognitive 

item table 
TABLE.QUS: questionnaire 

item table 



FIGURE 2. General organization of the databank directories and files 



The documentation files can be printed but they arc also intended to be read by 
programs that will print codebooks and provide entry into statistical analysis 
systems. In particular, the TABLE.COG and TABLE.QUS files are extracted 
from A. 3 and A.4 for direct use by analysis programs. 



A3. Purpose oi the Training 

In a project of this size and importance (and infrequency), the databank will be of 
interest to secondary analysts for years. It is likely that the most important analyses 
will be secondary ones, perhaps for purposes we have not imagined and using 
analytic tools not yet invented. However, the size and complexity of the databank 
means tiiat secondary analysts will need special training to gain access to the 
databank and to make efficient and accurate use of tlie data and their documentation. 
This manual outlines the nature of that training and is intended for use in a training 
course or for individual study. 

The first goal of the training is to understand how to interpret the data and 
documentation in the Databank. TTie response data are spread outover 24 files, the 
documentation includes 9 files, and the control, working, and denionstration files 
account for 6 more. It is necessary to understand the structure of the data files, the 
content and coding of the documentation files, and the linkages across data files and 
between data and documentation. The second goal is to know how to apply the 
databank for somt major types of analyses, including cross-national descriptive 
tabulation of the questionnaires, analysis of the cognitive achievement instruments, 
and in-depth analysis relating student achievement with classroom factors. The final 
goal of the training is to practici nalysis, using the demonstration programs and 
working files. 




B. INTERPRETATION 



B1. Data Identification Codes 



The eight countries whose data arc stored in the databank are uniformly 
identified as follows: 



15 
22 
25 
40 



Belgium Flemish 
British Columbia 
Ontario 
France 



54 
63 
79 
81 



Japan 

New Zealand 

Thailand 

U.S.A. 



10 



Within countries, the identification for data is funher broken down according to: 



Stratum 


from the national sampling design, 2 digits 


School 


numbered within or across strata, 3 digits 


Classroom 


numbered within school, 2 digits 


Teacher 


numbered within or across schools, 3 digits 


Student 


numbered within classroom, 3 digits 



The n-sting of identification codes-«.g., schools numbered within strata or 
numbered across strata-is not the same for all countries, but information will be 
unambiguously identified if all identification codes are used. That is: 

School use statum and schcol codes 

Teacher use stratum, school, and teacher codes 

Classroom use stratum, school, and classroom codes 

Student use stratum, school, classroom, and student codes 

Generally, classroom and teacher refer to the same unit and the same data 
records. Only in the case where the same teacher is the teacher for two 
classrooms is a distinction made. Then the teacher code should be the same, but 
the classroom code will be different 



The Special Case of Belgium Flemish 

Due to an error that occurred early in the processing of the Belgium Flemish data, 
the correspondences of student-level data ftxsm the pretest to the posttest and ftxsm 
the questionnaire to the cognitive test data were lost, except to the level of 
classroom. 

For the purpose of assembling the databank, an arbitraiy match-up of data was 
made, so that the format of the Belgium Flemish student data file looks like the 
format of the other countries. However, there is no promise whatsoever that the 
pretest, posttest, and quesionnaire data coded under one student identification 
code come fi-om the same student. 

Obviously, student level analysis thrt requires linking the information across tests 
and questionnaires is inpossible. Analysis on classroom aggregations should be 
correct. 
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B3. Instrument Identification Codes 



In the original ccxlcbooks and in the databank, the different survey instruments 
and tests for student level information are identified with these codes: 

500 Student p: ^♦cst questionnaire 

5 1 0 Student cogniuve pretest - core 

511 S tudent cognitive pretest - fomi A 

5 1 2 Student cognitive pretest - fomi B 

5 1 3 Student cognitive pretest - fomi C 

514 Student cognitive pretest - fonn D 
520 Student posttest questionnaire 

530 S tudent cognitive posttest - core 

531 S tudent cognitive posnest • form A 

532 Student cognitive posttest - fomi B 

533 Student cognitive posttest - fomi C 

534 Student cognitive posnest - form D 

For instruments at the teacher/classroom level, the following codes are used: 

600 Teacher background questionnaire 

6 1 0 Topic specific questionnaire - fractions 

61 1 Topic specific questionnaire - ratio, proportion, percent 

612 Topic specific questionnaire - measurement 

6 1 3 Topic specific questionnaire - algebra 

614 Topic specific questionnaire - geometry 

6 1 5 General classroom process questionnaire 

620 Opportunity to learn - core 

62 1 Opportunity to leam - fomi A 

622 Opportunity to leam - fomi B 

623 Opportunity to leam - fonn C 

624 Opportunity to leam - fomi D 

Finally, for school-level data, there is one instrument: 
800 School que:,i. ^nnairc. 

B4. Deciphering the Documentation Files (Documentation File A.O) 

The databank documentation files A. 0 to A,6 contain their own defuiitions and 
explanations. \s explained in 4.0, each file begins with a line filled with 
asterisks. Tliis is foUowed by an introductory text explaining the purpose of the 
file and the layout of the main content. Then thcrfi is a line of minus signs and 
specially formatted table or coded listing that is intended for visual inspection or 
programmed interpretation. The fuial line of a file is filled with slashes. 

The analyst is advised to make a complete printout of the documentation files and 
also a printout of a page or two of each data file. Sec also Appendix IV. 
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Instrur!>ent DWWzdtlon (Documentation File A. 1) 



Not all instruments were used in all countries. In the documentation file A.l, 
Basic Parameters and Sizes, is given definitive information on which instruments 
were used in each country. Also indicated is whether the original application of 
the instrument was in the cross- sectional or longitudinal format (this mainly 
concerns item order, and in the construction of this databank, the differences have 
been annotated or reconciled). For the cognitive tests, there is indication of which 
questions (response, calculator, OTL) were asked of students, since this varied 
from country to country and across forms. 



Response Data Layout (Documentation Fiie A.2) 

There arc 24 response data files, corresponding to the 3 levels of data (student, 
teacher-classroom, and school) for each of the 8 countries. The files are recorded 
ui plain, printable text (ASCE or EBCDIC) with records that are no longer than 
80 characters. On some systems, they wiU be of variable length, with blanks to 
the right stripped off, and on other systems they will be filled with blanks to 
exactly 80 characters. 

The layout of th? response data files is explained in detail in the documentation 
file A2. The mai. features of the layout are as follows: 

1 . There is a fixed number of records per case, i.e., per scha-)l, teacher, or 
student. The n umber of records varies from country to v-^ountrv-, 
depending on wiiioh instruments V. ere employed (see dwumtntatio. He 



2. A block of records - corresponding to a school, a teache , or a student - 
begins with a special identification record, which gi/es tlie ID codes for 
the position of the case in the data hierarchy and also give s special data 
availability codes for each of the possible data collection instruments that 
could apply to the case. The layout and coding of the ideniincaticn 
record is explained in document file /4 .2. 

3 . The response data records follow the identification record in fixed order 
and with the instrument and record within instrument indicated. The 
division of t!ie information into records follows the original international 
codebooks. 

The precise card and column location of va-iables can be determined firom the 
cognitive and questionnaire item tables (documentation files A. 3 and A.4 ). 
Because of the reairangment of columns in the databank, cognitive items columns 
are test positions +7 and questionnaire columns are original positions -13. 

This layout is illustrated in Figure 3, which contains an extract from the USA 
student data file, STUDENT:ALL.USA. 




Pretest questionnaire OK (2) 



Country 81 (USA), 
Stratum 1, School 67, 
Classroom 1, Student 7 



Posttest questionnaire OK (2) 



Core pretest present but probably 
not fmished (2) . Rotateid form 
at pretest is OK (3) and is form B 



i 



(2). At posttest, core (3) and rotated 
form (3) are OK, and form is C (3). 



81 1 67 1 7 2 2 232333 
5001 215705122143411224 

5201 216207321993444070406050000181188 888811121111111 

5202 132322321123233344412211222111411144411344411 

5203 414115515515154555515143^12455135541145444292245433255 

5101 432424125413335341333355233152351 45r32 999 

5102 1111111113111333331119333331313333339999 
5121 54534125345235443455554242144325111 

5301 3335212254235452114213211315521321312144 

5302 3333333333999999999999999999999999999999 
5331 43425453543415551144451545153514113 

81 1 67 1 8 2 2 333331 
5001 216502233244223123 

5201 217202841994445010110130000113888888388331131111 

5202 135143311132223223233312224223324223222233311 

5203 425325335431243535315133311432434313115325999999999999 

5101 2342444224534254214215421251531351113 412 

5102 3131333313131131333333111311111111131313 
5131 53435253543135433341524215253414153 

5301 2134414224543351213215514323551355121444 

5302 3131111313333331333133133131331339331311 
5311 43214424351255532213513252123241124 



5001 = pretest questionnaire 

5201 - posttest questionnaire, card 1 

5202 = posttest questionnaire, card 2 

5203 = posttest questionnaire, card 3 

5101 = pretest cognitive core item responses 

5102 = pretest cognitive core OTL 

5121 = pretest cognitive rotated form B item responses 

5301 = posttest cognitive core item responses 

5302 = posttest cognitive core OTL 

5331 = posttest cogntive rotated form C item responses 



Figure 3. Illustration of resDonse data layout for student files 
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B7. 



Cognitive Testing Arrangement (Documentation File A.3) 



The mathematics tests were based in Japan on a cross-sectional set of 176 items, 
divided into a core :e^t of 40 items and 4 rotated forais of 34 items each, and 
elsewhere on a longitudinal set of 180 items, divided into a suggested core test 
of 40 items and 4 suggested rotated forms of 35 items each. There arc 157 items 
in the overlap. Details arc given in documentation files A.2 and, especially, 
A3, Cognitive Item Coding, the main content of which is also available in the 
TABLE.COG file, ready for automatic processing. 

Generally, a form of matrix sampling was used, with each student taking a core 
test and also one of four rotated form. The overall testing anangements are 
sununarized below, and in Figure 4 is shown how to interpret the cognitive item 
table. 



Belgium Flemish 



British Columbia 



Ontario 



France 



Japan 



New 2^aland 



Thailand 



U.S.A. 



Longitudinal forms adjusted to Belgium Flemish 
curriculum. Core and rotated form at pretest, core and 
rotated fomi at posttest, complete rotation between pre 
andposttest. NB: Some linkage has been lost. 

Standard longitudinal fomis, with onp minor 
adjustment. Core only at pretest. C(*e and rotated 
fomis at posttest. 

Standard longitudinal fomis. Core and rotated form at 
pretest, core and rotated form at posttest, complete 
rotation between pre and posttest. 

Longitudinal forms adjusted to French curriculum. 
Core and rotated form at pretest, core and same rotated 
form at posttest. 

Special 60-item pretest selected from cross-sectional 
items. Cross-sectional core and rotated form at 
posttest. 

Standard longitudinal forms. Core and rotated form at 
pretest, core and rotated form at posnest, complete 
rotation between pre and posttrst. 

Standard longitudinal forms. Core and rotated form at 
pretest, core and rotated form at posttest, wiUi rotation 
at posttest excluding repetition of the same form. 

Standard longitudinal forms. Core and rotated form at 
pretest, core and rotated form at posttest, complete 
rotation between pre and posttest. Extra sample of 
classrooms with posttest only. 
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Hungarian number 
of the item 



I 



001 

15 
22 
25 
40 
54 
63 
79 
81 



Approximate text 



The item is found in a 
standard position for all 
countries. No problems, 
as indicated by the 3-digit 
codes for adnunstration 
as teacher OTL, student 
pretest, and student 
posttest. Countries do 
vary in what is asked 
and when. 



(22 * 18) - (47 • 
1 001 1 1 0 20 2 
2 34 527 513 511 
2 34 527 000 513 
2 34 527 515 515 
2 34 527 517 517 
0 20 527 000 523 
2 34 527 517 517 
2 34 527 517 517 
2 34 527 515 515 



• 59) IS EQUAL TO 

34 0 1 6 03 05 06 08 09 15 45 



002 MATCHSTICKS ARE ARRANGED AS FOLLOWS. IF THE PATTERN IS 

2 DDI 3 0 0 31 4 12 0 1 6 09 15 16 
15 4 12 527 513 511 
22 4 12 527 000 513 
25 4 12 527 515 515 
40 4 12 527 517 517 

54 0 31 527 523 523 2 34 < 

63 4 12 527 517 517 
79 4 12 527 517 517 
81 4 12 527 515 515 



\ 



correct response is A (1). 
content is from Whole Numbers (001). 
behavioural level is Computation (1). 
an anchor item from the First Math Study (1). 
core (0) item 20 in the cross*sectional study, 
form B (2) item 34 in the standard longitudinal instruments, 
not international longitudinal core (0). 
arithmetic (1) stratum in cross-sectional core construction, 
integers (6) in longitudinal form construction, 
member of various subtests (03. 05....) 



This will be item 54 
in thf special Japanese 
pretest, which has one 
pan of 20 items and 
one of 40. 



Figure 4. Interpretation of the cognitive item table 
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B8. 



Evaluations of Data Quality (Documentation File TABLE.COG) 



A major purpose of the elaborate documentation is to record the national variations 
and iiregulaniics that inevitably occur in an international study of this magnitude. 
In the cognitive item table, each item is coded for each country according to 
virhether it was: 

0 not used 

1 used but spoiled, e.g., by a misprinting 

2 used with non-standard alternatives and text 

3 used with non-standard dtematives but standard text 

4 used with standard alternatives but non-standard text 

5 used in standard form 

In fact, this coding is given for each potential application of an item: in the pretest, 
in the posttest, and for teachers' evaluations of opportunity to learn. Most items 
are now coded as "5"» but can be anticipated that as secondary analysts make more 
careful examination of the items, additional problems will be discovered, and it can 
be hoped that this tabulated data can be updated and made available to the analyst 
community. 

B9. Questionnaire Data Interpretation (Documentation File A.4) 

Extracts from documcntatioi. file A .4 are given in Figure 5. One of the purposes 
of this section of the documentation is to provide a uniform system of naming the 
variables in the study. The first letters of the suggested names are determined by 
the data source: 

S School questionnaire 

T Teacher background questionnaire 

F Fractions topic specific questionnaire 

R Ratio proportion percent topic specific questionnaire 

M Measurement topic specific questionnaire 

G Geometry topic specific questionnaire 

A Algebra topic specific questionnaire 

C Classroom process general questionnaire 

X Beginning of year student background/attitude questionnaire 

Y End of year student background/attitude questionnaire 

The file also contains linkage to the original question numbers in the 
questionnaires and to the card and column numbers from the original international 
codebooks. An abbreviated variable label is provided and should be acceptable to 
most statistical packages. Finally, for any items known to deviate in a country 
from the international standard, there is a coding similar to that used for cognitive 
items and a short explanation. 
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Suggested 
variable name 



Original 
data collection 

instrument 
and question. 



Record, column, 
and field width 
for response data 

Reference 
to cross- sectional 
instrument question 
number 



Suggested 
variable label 



SAREA 

15 3 
40 3 
54 3 
SENROLB 
SENROLG 
SAPOPB 
15 4 
SAPOPG 
15 0 
SNOMTHB 
15 0 
22 0 
40 0 
54 0 



National 
variaD'^ns 



800 1 1 20 1 
Expanded and reordered 
Contracted coding? 
Added code 6 for undecided 



1 KIND or COMMUNITY SERVED BY SCHOOL 
coding 



800 2 1 1 21 4 
800 2 2 1 25 4 
800 3 Al 1 29 4 
Apparently this is 
800 3 A2 1 33 4 

Not available, but 
800 3 Bl 1 37 4 3 BOYS. .POP 

Not used, since all take math 

Not used, since all take math 

Not used, since 9li Y.ajce math 

Not used, since all take math 



2 BOYS.. TOTAL ENROLMENT IN SCHOOL 

2 GIRLS.. TOTAL ENROLMENT IN SCHOOL 

3 BOYS. .POPULATION A STUDENTS IN SCHOOL 
number of population A girls 

3 GIRLS. .POPULATION A STUDENTS IN SCHOOL 
see SAPOPB 

A WHO DO NOT TAKE MATH 



Attitudf scale number 



5 


YFUN 


520 


54 


3 


34 


1 


5 


63 


I THINK MATHEMATICS IS FUN 


5 


YALLCMP 


520 


4- C 


3 


35 


1 


8 


83 


EVERYONE SHOULD LEARN ABOUT COMPUTERS 




25 4 


Question 


was 


If use calculator, don't have to learn to compute 


5 


YCHANGE 


520 


56 


3 


36 


1 


3 


31 


MATH WILL CHANGE RAPIDLY NEAR FUTURE 


5 


YWOMCAR 


520 


57 


3 


37 


1 


6 


68 


A WOMAN NEEDS A CAREER AS MUCH AS MAN 


5 


YALWRUL 


520 


58 


3 


38 


1 


3 


41 


ALWAYS A RULE IN SOLVING A MATH PROBLEM 


5 


YSCARED 


520 


59 


3 


39 


1 


5 


61 


IT SCARES ME TO HAVE TO TAKE MATHEMATICS 


5 


YMTHJOB 


520 


60 


3 


40 


1 


7 


69 


MATH IS IMPORTANT TO GET A GOOD JOB 




15 0 


Not 


used 
















25 4 


Referred 


to 


arithmetic 


rather than mathematics 


5 


YNEVER 


520 


61 


3 


41 


1 


4 


57 


I COULD NEVER BE A GOOD MATHEMATICIAN 


5 


YHELPO 


520 


62 


3 


42 


1 


4 


52 


I LIKE TO HELP OTHERS WITH MATH PROBLEMS 



Figure 5. Interpretation of the questionnaire item table 
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BIO. National Sampling \niormaY\on (Documentation File A.5) 



Each participating country drew a national sample according to an sampling plan 
that had to have been approved by the international sampling referee. The 
samples are generally stratified and multistaged. Documentadon file ^4 J contains 
textual explanations of the sampling plans, including definitions of the sampling 
strata, clusters, and subsamplings; fomiulas for the derivation of national 
statistics; and all necessary population sizes and weights for producing standard 
statistical estimates. 



B1 1. Questionnaire Texts and Variations (Documentation File A6) 

Documentation file A.6 consists of a coded text that includes: 

- the full English text of the questions from the original international 
instruments, including the question stems and the response 
alternatives 

- linkage to the questionnaire item table via the variable names 

- the numerical value coded for each of the response alternatives 

- suggested value labels for the response alternatives 

- indications of national variat*ons: extra or missing response 
alternatives, variations in question wording or intent, substitute 
questions, etc. 

This information is complexly formatted, but it can be read and inteipreted to 
guide the selection and use of items between the national datasets. It should also 
be possible to program automatic input of the file into special procedures for 
constructing national codebooks or statistical program setups. 

The details of this part of the documentation system are beyond the scope of this 
training manual, but they are described fully in the introductory section of the file 
and in a published report (Wolfe, R. G., ^'Integrating data and documentation in a 
multi-national research project: the lEA second international mathematics study. 
Proceedings of the Second International Workshop on Statistical Database 
Management, Los Altos, California, 1983. Lawrence Berkeley Laboratory, 
University of California, and U.S. Department of Energy.) 
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C APPLICAIION 



CL Cross-National Descriptive Tabulation of the Questionnaires 

In Figure 6 is shown the general flow of processing to use the documentation 
and data files to tabulate responses to the questionnaires over instruments and 
over countries. 

The actual processing steps are shown in square-edged boxes on the left. How 
exactly these are implemented will depend, of course, on the statistical 
programming system being used. In theory, all steps can be driven automatically 
from the machine-readable documentation files. Often in practice, careful, 
manual reading of the documentation file will assist die analyst in defining and 
setting up the statistical program. 

The round-edged boxes on the right of Figure 6 show the references to the 
different documentation files. 

C2. Analysis of Cognitive Achievement Instruments 

In Figure 7 is shown the general flow of processing to use the documentation and 
data flies to analyze the mathematics test information. 

The complex matrix sampling that was used to administer the mathematics tests 
implies that decisions need always to be made about how to construct and adjust or 
scale the subtest scores (total scores do not make sense in SIMS). Reference to the 
documentation file AA, Basic Parameters and Sizes, and tabulation of the 
TABLE.COG documentation file will be useful in arriving at a stragegy; an 
example is given in section Dl and Appendix I of this manual. 

In addition to the technical information about test formatting and item quality, die 
TABLE.COG table contains the content coding of die madiematics items and so it 
can be used to select items for subtests. 

The availability and completeness codes found in each block of student response 
data need to be considered, togedier widi sampling information from die 
documentation file A J. In panicular, a decision needs to be made of what to do 
with students who participated only in the pretest or only in the posttest. 

Also, something has to be done widi students who did not complete a test (die 
indication recoided in the file is based on the statistical likelihood of the pattern of 
omits as they appear at die end of die test relative to die total number of omits.) 
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Dcicmiinc the questionnaires to be 
tabulated and the variables to be 
included. 




From document file A.1 can 
be determined which countries 
used each questionnaire. 

V J 






Isolate national variations and 
exceptions and nfiake appropriate 
adjustments to the tabulation 
instrjctions. 


< 


Variable name, labels, and j 
locations are obtained from 
document file A.4 or from 
TABLE.QUS ; also warnings 
^ about national exceptions. j 






Locate the data itcords and 
columns in the response data file. 
Dctcmiine the response coding and 
build the input foraiat specification 

and tabulation instructions. 




/ ■ V 

The value labels are obtained j 
from document file A.6; also full 
explanations of national 
exceptions and substitute 
^ wording. J 






Invoke the tabulation program 
and cycle through to the next 
country. 




't. . ^ 

Information about the structure of 
the sample and sampling weights, if 
needed, can be obtained from 
document file A.5. 







i'igure 6. Processing flow for cross-national descriptive tabulation 
of the questionnaires 
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Determine which test forms were 
used and which questions were 
asked ai pretest and posttest times; 
decide on extraction and scaling or 
fomi adjustment strategy. 



I 



Detennine which mathematics 
content areas and items are to be 
included and make a pitliminaiy 
item selection. 



Locate the items in the national test 

forms; determine national 
exceptions and spoiled items and 
make appropriate adjustments. 



I 



Read through the response data file, 
checking the data availability and 

completeness codes and extracting 
the item responses depending on 
forms taken. Score and analyze. 



From document file A. 1 can be 

detemiincd the cogntive test 
formatting and use of rotation at 
pretest and posttest times. 



From the international lines of the 
cognitive item table, TABLE.COG, 
items can be selected based on 
content grid, behavioural level, 
subtest code, etc. 



From the national lines of the 
TABLE,COG file, the assignment 
of items to forms and positions can 
be seen as well as a crucial coduig 
of item quality. 



Sampling information and 
weights come from document file 

A«S. Codes defining data 
availability/completeness appear 
in each response data block. 



Figure 7, Processing flow for analysis of the cognitive achievement 
instuments 
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C3. Relational Analysis of Achievement and Classroom Factors 



In Figure 8 is shown the general flow of processing for an integrated analysis of 
student-level and classroom-level variables. 

As in the previous cases, the documentation files are used to drive the steps oi 
selecting and computing questionnaire items and mathematics subtest scores. In 
this case, the steps are carried out in parallel for student and classroom 
informaticm. For example, when a subtest is defined for student mathematics 
achievement, it is likely that there should be a parallel opportunity to leam (OTL) 
score calculated from the teacher response data, although the method of calculation 
may be quite different (teachers responded to all items, while matrix sampling was 
used for student responses.) 

When the inatching of student and classroom level data is made, the combined 
identification code for Stratum, School, and Classroom is key. However, the 
careful analyst will consider what to do with cases where the same teacher appears 
in both classrooms of a school. 

For both the student data and the classroom-teacher data, the availability and 
completeness codes found in each block of response data need to be examined, 
and decisions need to be made of what to do with students who participated only 
in the pretest or only in the posttest, with classrooms with no teacher data, of 
teacher data with no student data, etc. The goal of the databank construction has 
been to include all available data and to leave die selection problem for each analyst 
to solve. 



D. PRACTICE 

D1. Cognitive Item Classification 

The first practice analysis suggested for an analyst new to SIMS and its databank 
involves treating the TABLE.COG file as data for analysis and tabulation. 

in Appendix I are given the input to and the results from a MI^fITAB analysis of 
the filv*.. The purpose was to recover the content dimensions of the special 
Japanese pretest and the Japanese cross-sectional posttest core and rotated forms. 

Supgested exercises: (1) Do the same analysis for one of the other countries, 
which v/ill have used the longitudinal item set. (3) Create an output file widi the 
nece«iary item positions and keys to drive a subsequent analysis program that 
will create subtests scores or analyses. 
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Decide on a strategy 
for extracting and 
scaling or adjusting 
the stuoent cognitive 
test forms. 




< — 








Determine which 
contents to use for 
mathematics scores 
and locati; items in 
test forms. 










Read student data, 
checking availability 

coding; extract 
questionnaire data 

and compute 
mathematics scores. 





0^ N 

Document file A. 1 
shows the pretests, 

posttests, and 
questionnaires that 

are available. 



Files TABLE.COG 
andTABLEQUS 
show item contents, 
locations, and 
qualities. 



Match 
cases using 
stratum, school, 
classroom 
codes 



— ► 


Decide which 
questionnaires for 
teacher*classroom 

can be utilized. 








r 


— ► 


Make parallel 
selection of math 
itCiiis for teacher- 
classroom scoring 
ofOTL 




\ 








Read data for 
teacher-classroom, 
checking availabilty 

coding; extract 
questionnaire data 
and compute OTL. 



Merge data for 
student and teacher- 
classroom; carry out 
relational analysis. 



Sampling 
information and 
weights come from 
documeni file A.5. 



Figure 8. Processing flow for relational analysis of achievment and 
classroom factors 
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D2. 



International Item Response Analysis 



Included with the distribution of the databank is a demonstration program called 
LONGTAB.FOR and the "unofficial" working file LONGTAB.OUT which the 
program generated. The data file format, a partial listing of data, and a listing of 
the program are presented in Appendix II. 

The units of analysis are the 199 items, and the variables recorded include the 
basic classification infcmiation from the cognitive item table and an approximate 
response distribution - right, wrong, omit by pretest, posttest - over countries. 
The response distribution is based on simple tabulation of the student data, so the 
estimates are not properly weighted. They should be sufficiently accurate for the 
purpose of practice. 

Suggested exercises: (1) Compare gain from pretest to posttest with initial pretest 
level by subtest-as defined by the grid-and country. (2) Check omit rates over 
countries and detenmine the effect of "correction" for "guessing". 



D3. U.S.A. Classroom Relational Analysis 

The process of putting together a full aggregate file from the databank, if done 
with proper attention to all the coding variations, formatting differences, etc., is 
rather long. Included with the databank is another "unofficial" working file, 
COMBO.USa, of classroom-level variables and ajggregates for the U.S.A. Again 
no guarantees are made of the accuracy or appropriateness of the data. It is 
intended for practice. 

The file includes basic information fiom the teacher background questionnaire, the 
complete set of responses to the general classroom process questionnaire, 
adjusted subscores for student pretest and posttest mathematics achievement in 6 
content areas, and teacher estimates of prior and current opportunity to learn for 
the same content areas. Also included is a special U.S.A. national coding of 
mathematics class type, which is considered to be a crucial variable there. 

The layout of the file and a listing of an SPSS-X program setup for its use are 
presented in Appendix HI. The setup program, COMBO.SPS, is also included in 
the databank distribution. 

Suggested exercises: (1) Determine the regression of posttest on pretest and 
compare that over subtests. (2) Include some of the teacher characteristics in a 
multiple regression. 
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Appendix I. Analysis of the Cognitive Item 'able 



Page 1 MINTTAB program listing 
Page 2-9 Results 



Appendix I, page 1 

note reads the cognitive item table international item 

note number and major grid position and then the form assignments 

note for Japan. 

fread 'document: table. cog' into c1-c2 c11-c12 c2l-c22 
(f3.0/6x,f1.0/////3x,f1.0,f3.0,12x,f2.0,f3.0///) 

name c1 'Hungnum' 
name c2 'Grid' 
name c1 1 *Postform' 
name cl2 •Postitem' 
name c2l 'Preform' 
name c22 'Freitem' 

note omit the items that are longitudinal only. 

omit 0 in c12 carrying c1 c2 c11 c21 c22 putting into c12 c1 c2 c11 c21 c22 

note check distribution by grid level 

histo c2 
table c2 cTI 

note construct a single code combining posttest form and item 

multipy c11 by TOO put into c13 
add cl2 to c13 put into c13 

note sort and print an item table for posttest 

sort cl3 carrying c1 c2 c11 c12 c2l c22 putting into c13 c1 c2 c11 c12 c2l c22 
print c1 c2 c11 cl2 c21 c22 

note omit items not on the pretert 

omit 0 c22 carrying c1 c2 c11 c12 c2l putting into c22 c1 c2 c11 c12 c21 

note construct a single code combining pretest form and item 

multiple c21 by 100 put into c23 
add c22 to ' 23 put into c23 

note so'^t and print an item table for posttest 

sort cl3 carrying c1 c2 c11 cl2 c21 c22 putting into c23 c1 c2 c11 cl2 c21 c22 
print c1 c2 c11 c12 c21 c22 

note check grid distribution on pretest 

histo c2 

stop 
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Appendix I, page 2 

MTB > histo c2 
Grid 

MIDDLE. OF NUMBER OF 
INTERVAL OBSERVATIONS 

0 1(6 

1 HO •»»»*»»»««««««««««««««««««««««««««««»»»« 

2 118 

3 18 ««»««»»»»»»«»»»»»« 

H 2H »•»»»•»»»»»»»»»»»»»»»»»» 

MTB > table c2 c11 



ROWS: 


Grid 


COLUMNS: 


Post form 








0 


1 


2 


3 


n 


0 


11 


8 


9 


8 


10 


1 


9 


8 


7 


9 


7 


2 


11 


10 


10 


9 


8 


3 


i| 


3 


3 


^ 


^ 


H 


5 


5 


5 




5 


ALL 


HO 


3^* 


3^* 


3'< 





ALL 

16 
10 
18 
18 
21 
176 
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Appendix I, page 3 



MTB > print c1 c2 c11 c12 c21 c22 





Hungnum 


Grid 


Postform 


Postitem 


Preform 


Preitem 


1 


in 


1 


0 


1 


2 


12 


2 


27 


2 


0 


2 


0 


0 


3 


6 


0 


0 


3 


2 


4 


11 


12 


1 


0 


i| 


0 


0 


5 


30 


2 


0 


5 


0 


0 


6 


25 


2 


0 


6 


0 


0 


7 


32 


3 


0 


7 


0 


0 


8 


no 


n 


0 


8 


1 


18 


9 


22 


2 


0 


9 


1 


13 


10 


15 


1 


0 


10 


1 


11 


11 


39 


n 


0 


11 


0 


0 


12 


17 


1 


0 


12 


2 


10 


13 


31 


2 


0 


13 


2 


25 


in 


n 


0 


0 


14 


0 


0 


15 


3n 


3 


0 


15 


0 


0 


16 


20 


1 


0 


16 


0 


0 


17 


3 


0 


0 


17 


1 


1 


18 


5 


0 


0 


18 


0 


0 


19 


26 


2 


0 


19 


1 


15 


20 


1 


0 


0 


20 


0 


0 


21 


33 


3 


0 


21 


0 


0 


22 


18 


1 


0 


22 


2 


18 


23 


10 


0 


0 


23 


2 


32 


2H 


37 


n 


0 


24 


0 


0 


25 


16 


1 


0 


25 


2 


15 


26 


8 


0 


0 


26 


1 


6 


27 


35 


3 


0 


27 


0 


0 


28 


21 


2 


0 


28 


0 


0 


29 


29 


2 


0 


29 


2 


2n 


30 


36 


n 


0 


30 


0 


0 


3' 


2 


0 


0 


31 


2 


3n 


32 


23 


2 


0 


32 


1 




33 


9 


0 


0 


33 


2 


5 


3^ 


11 


0 


0 


34 


0 


0 


35 


7 


0 


0 


35 


1 


2 


36 


2n 


2 


0 


36 


0 


0 


37 


38 


n 


0 


37 


2 


29 


38 


28 


2 


0 


38 


2 


19 


39 


19 


1 


0 


39 


1 


12 


no 


13 


1 


0 


40 


2 


in 
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Appendli I, page 4 



ROW 


Hungnum 


Grid Postform 


Postritem 


Preform 


Preitem 


41 


52 


1 1 


1 


0 


0 




55 


1 1 


2 


2 


1b 




50 


1 1 


3 


0 


0 


kU 


62 


2 1 


n 


0 


0 


15 


72 


a 1 


5 


1 


20 


H 


173 


2 1 


6 


0 


0 


IT 


67 


3 1 


7 


0 


0 


ii8 


169 


2 1 


8 


0 


0 


49 


57 


2 1 


9 


0 


0 


50 


nil 


0 1 


10 


2 


3 


51 


H3 


0 1 


11 


0 


0 


52 


69 


a 1 


12 


2 


28 


53 


58 


2 1 


13 


0 


0 


51 


611 


2 1 


in 


0 


0 


55 


51 


1 1 


15 


0 


0 


56 


il6 


0 1 


16 


1 


5 


57 


118 


0 1 


17 


0 


0 


58 


63 


2 1 


18 


0 


0 


59 


65 


3 1 


19 


0 


0 


60 


U7 


0 1 


20 


2 


6 


61 


US 


0 1 


21 


0 


0 


62 


H9 


1 1 


22 


0 


0 


63 


71 


a 1 


23 


1 


17 


611 


66 


3 1 


211 


0 


0 


65 


70 


a 1 


25 


2 


27 


66 


60 


2 1 


26 


0 


0 


67 


i;i 


0 1 


27 


0 


0 


68 


56 


1 1 


28 


0 


0 


69 


53 


1 1 


29 


2 


9 


70 


61 


2 1 


30 


1 


m 


71 


68 


a 1 


31 


0 


0 


72 


5H 


1 1 


32 


0 


0 


73 


^2 


0 1 


33 


0 


0 




59 


2 1 


3ii 


2 


26 
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ROW 


Hungnuni 


Grid 


Postform 


75 


86 


1 


2 


76 


100 


a 


2 


77 


93 


2 


2 


78 


85 


1 


2 


79 


88 


1 


2 


80 


95 


2 


2 


81 


ion 


a 


2 


82 


in 


0 


2 


83 


73 


0 


2 


814 


176 


2 


2 


85 


80 


0 


2 


86 


78 


0 


2 


87 


83 


1 


2 


88 


96 


2 


2 


89 


90 


2 


2 


90 


89 


2 


2 


91 


101 


^ 


2 


92 


97 


3 


2 


93 


99 


3 


2 


9H 


171 


2 


2 


95 


103 


a 


2 


96 


81 


0 


2 


97 


77 


0 


2 


98 


79 


0 


2 


99 


91 


2 


2 


100 


75 


0 


2 


101 


76 


0 


2 


102 


87 


1 


2 


103 


BH 


1 


2 




102 


H 


2 


105 


98 


3 


2 


106 


92 


2 


2 


107 


9H 


2 


2 


108 


82 


1 


2 



Appendix I, page 5 
Postitem Preform Preitem 



1 


2 


11 


2 


0 


0 


3 


0 


0 


11 


0 


0 


5 


0 


0 


6 


0 


0 


7 


0 


0 


8 


2 


35 


9 


0 


0 


10 


0 


0 


11 


2 


31 


12 


1 


H 


13 


0 


0 


IK 


0 


0 


15 


0 


0 


16 


0 


0 


17 


0 


0 


18 


0 


0 


19 


2 


no 


20 


0 


0 


21 


0 


0 


22 


0 


0 


23 


0 


0 


211 


1 


8 


25 


0 


0 


26 


1 


3 


27 


0 


0 


28 


0 


0 


29 


0 


0 


30 


0 


0 


31 


0 


0 


32 


0 


0 


33 


0 


0 


311 


1 


10 
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ROW 


Hung., am 


Grid 


Post form 


109 


111 


1 


3 


110 


130 


•5 


3 


111 


175 


2 


3 


112 


108 


0 


3 


113 


133 


H 


3 


nil 


136 




3 


115 


125 


2 


3 


116 


132 


3 


3 


117 


105 


0 


3 


118 


129 


3 


3 


119 


135 


H 


3 


120 


109 


0 


3 


121 


126 


2 


3 


122 


131 


3 


3 


123 


116 


1 


3 


12il 


107 


0 


3 


125 


119 


1 


3 


126 


121 


2 


3 


127 


128 


2 


3 


128 


110 


0 


3 


129 


120 


1 


3 


130 


112 


0 


3 


131 


113 


1 


3 


132 


172 


1 


3 


133 


127 


2 


3 


13'» 


121 


2 


3 


135 


123 


2 


3 


136 


117 


1 


3 


137 


131 


H 


3 


138 


122 


2 


3 


139 


106 


0 


3 


1i»0 


115 


1 


3 


1i»1 


111 


0 


3 


142 


118 


1 


3 
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Post item Preform Preitem 



1 


0 


0 


2 


0 


0 


3 


0 


0 


1 


2 


1 


5 


0 


0 


6 


0 


0 


7 


0 


0 


8 


0 


0 


9 


0 


0 


10 


2 


39 


11 


0 


0 


12 


0 


0 


13 


0 


0 


14 


0 


0 


15 


0 


0 


16 


0 


0 


17 


0 


0 


18 


0 


0 


19 


0 


0 


20 


2 


8 


21 


2 


13 


22 


0 


0 


23 


1 


9 


24 


0 


0 


25 


0 


0 


26 


2 


20 


27 


0 


0 


28 


0 


0 


29 


0 


0 


30 


0 


0 


31 


0 


0 


32 


0 


0 


33 


0 


0 


34 


0 


0 
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•ROW 


Hungnum 


Grid 


Postform 


1H3 


159 


2 


4 




155 


2 


4 


1H5 


mi 


0 


i| 


116 


151 


2 


it 


in? 


116 


0 


H 


1i48 


110 


0 


H 


1il9 


113 


0 


H 


150 


161 


1 


H 


151 


153 


1 


H 


152 


150 


1 


H 


153 


163 


3 


H 


151* 


117 


1 


H 


155 


115 


0 


H 


156 


138 


0 


H 


157 


139 


0 


H 


158 


111 


0 


H 


159 


168 


1 


H 




166 


1 


H 


161 


liiS 


1 


H 


162 


167 


1 


H 


163 


152 


1 


H 


161 


137 


0 


H 


165 


162 


3 


H 


166 


171 


2 


n 


167 


157 


2 


n 


168 


112 


0 


n 


169 


170 


2 


n 


170 


165 


1 


n 


171 


156 


2 


n 


172 


151 


1 


n 


173 


119 


1 


n 


\n 


158 


2 


n 


175 


160 


3 


n 


176 


161 


3 


n 
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Postitem Preform Preitem 



1 2 21 

2 2 23 

3 0 0 
10 0 

5 0 0 

6 0 0 

7 2 7 

8 0 0 

9 2 17 

10 0 0 
110 0 

12 0 0 

13 0 0 

11 0 0 

15 2 2 

16 0 0 

17 2 30 

18 0 0 

19 0 0 

20 1 19 

21 0 0 

22 2 33 

23 2 38 
21 2 22 

25 0 0 

26 1 7 

27 0 0 

28 0 0 

29 0 0 

30 0 0 

31 0 0 

32 0 0 

33 2 36 
31 2 37 
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MTB > print c1 c2 c11 c12 c21 c22 



ROW 


Hungnum 


Grid 


Post form 


1 


3 


0 


0 


'5 
d. 


7 


0 


0 


3 


75 


0 


2 


h 

*4 


78 


0 


2 


5 




0 


1 


/: 
D 


8 


0 


0 


7 


142 


0 


11 


0 


79 


0 


2 


9 


113 


1 


3 


10 


82 


1 


2 


1 1 


15 


1 


0 


12 


19 


1 


0 


13 


22 


2 


0 




61 


2 


\ 


15 


26 


2 


0 


ID 


23 


2 


0 


17 


71 


4 


1 


lo 






0 


19 


167 




li 




72 




1 


21 


108 


0 


3 


22 


139 


0 


li 


23 




0 


1 




0 


0 


0 


25 


9 


0 


0 


26 


^1 


0 


1 


27 


143 


0 


i( 


28 


110 


0 


3 


29 


53 


1 


1 


30 


17 


1 


0 



17 
35 
26 
12 
16 
26 
26 
211 
23 
3'» 
10 
39 
9 

30 
19 
32 
23 

8 
20 

5 

K 
15 
10 

3 
33 
20 

7 
20 
29 
12 



2 
2 
2 
2 
2 
2 
2 
2 
2 
2 



1 
2 
3 

n 

5 
6 
7 
8 
9 
10 
11 
12 
13 

in 

15 
16 
17 
18 
19 
20 
1 

2 
3 

5 
6 
7 
8 
9 

10 
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nungnuin 


uriu 


roswi orin 


rosui wem 


D M A ^ A M M 

rreiorm 


Preltem 


Qi 


Ov 




c. 


1 




1 1 




111 


: 


U 


1 


2 


12 


00 


1 9n 

1 C\J 




0 


0 1 
C 1 


c 


1j 








U 


Ijn 




1 Jl 




ID 


: 
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15 


JO 
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lo 
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Ji 




c. 


17 


JO 


1 o 




A 

U 


OP 


c 


lo 


jy 




o 
c 


A 

u 


JO 


c 


19 




1 9li 


o 
c 


J 


pA 




20 


ill 




c. 


Jl 


1 




21 


119 


1 7ll 




Jl 


oil 


c 


22 


**J 




o 
c 


Jl 


c 


c 


23 


ilil 


PQ 


c 


A 
W 


PQ 


c 


OJl 

2*1 






c 


A 
W 


1 J 


c 


25 


lift 




p 
c 


1 

1 


911 
J** 


c 


oil 
20 




70 


ii 


1 

1 




c 


27 


HO 


AO 




1 


1 p 


c 


2o 


ilQ 


JO 


J] 


A 
U 


Q7 
Jf 




29 




1 vO 


\\ 

H 


Jl 


17 

1 f 




OA 


0 1 




A 
U 


c 


1 1 


c 


O 4 

31 


9t 




n 

\j 


A 
W 


PQ 
t J 


c 


oo 
32 


00 


1 ^7 


n 

w 


Jl 


5P 


c 


oo 

33 




2 


n 

V 


0 
w 


0 1 


c 


oil 
3** 


55 


Til 


0 


2 


8 


2 


35 


56 


160 


3 


li 


33 


2 


36 


57 


161 


3 


li 


3H 


2 


37 


58 


162 


3 


li 


23 


2 


38 


59 


129 


3 


3 


10 


2 


39 


60 


99 


3 


2 


19 


2 


HO 



MTB > histo c2 



Grid 

MIDDLE OF NUMBER OF 

INTERVAL OBSERVATIONS 

0 21 ***** 

1 ***** 

2 12 ***** 

3 5 

i, 8 
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Pages 5-9 Listing of Fortran program (LONGTAB.FOR) 
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INTERNATIONAL ITEM RESPONSE FILE LAYOUT 



INTERNATIONAL LINE ONE 
1-3 ITEM REFERENCE NUMBER FROM ITEM BANK 
5-80 ABBREVIATED TEXT OF THE INTERNATIONAL FORM OF THE ITEM 

INTERNATIONAL LINE TWO 

5 rORRECT RESPONSE ALTERNATIVE 

1A 2B 3C 5E 

7-9 POSITION IN INTERNATIONAL CONTENT GRID 



000 


ARITHMETIC 


204 


SIMILARITY 


001 


WHOLE NUMBERS 


205 


GEOMETRIC CONSTRUCTIONS 


002 


COMMON FRACTIONS 


206 


PYTHAGOREAN 


003 


DECIMAL FRACTIONS 


207 


COORDINATES 


oon 


RATIO, PROPORTION, PERCENT 


208 


DEDUCTIONS 


005 


NUMBER THEORY 


209 


TRANSFORMATION (INFORMAL) 


006 


POWERS 


212 


SPATIAL VISUALIZATION 


100 


ALGEBRA 


215 


TRANSFORMATIONAL GEOMETRY 


101 


INTEGERS 


300 


PROBABILITY AND STATISTICS 


102 


RATIONALS 


302 


ORGANIZATION 


103 


INTEGER EXPONENTS 


303 


REPRESENTATION 


ion 


FORMULAS 


304 


MEAN, MEDIAN, MODE 


105 


POLYNOMIALS EXPRESSIONS 


306 


PROBABILITY 


106 


EQUATIONS AND INEQUATIONS 


400 


MEASUREMENT 


107 


RELATIONS 


401 


UNITS 


200 


GEOMETRY 


402 


ESTIMATION 


201 


CLASSIFICATION 


403 


APPROXIMATION 


202 


PROPERTIES 


404 


DETERMINING MEASURES 


203 


CONGRUENCE 







11 BEHAVIOURAL LEVEL 

1 COMPUTATION 

2 COMPREHENSION 

3 APPLICATION 

4 ANALYSIS 

13 ANCHOR ITEM STATUS 

0 NOT AN ANCHOR 

1 ANCHOR ITEM 

2 MODIFIED ANCHOR ITEM 
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15 FORM PLACEMENT FOR THE CROSSSECTIONhL STUDY 

17-18 POSITION WITHIN FORM FOR THE CRQSSSECTONAL STUDY 

20 FORM PLACEMENT FOR THE ICMGITUDINAL STUDY 

22-23 POSITION WITHIN FORM FOR THE LONGITUDINAL STUDY 

NOTE... THE PLACEMENT AND POSITION NUMBERS ARE ZERO 
FOR ITEMS NOT INCLUDED IN A GIVEN STUDY. THE 
PLACEMENT AND POSITION NUMBERS FOR THE LONGITUDINAL 
STUDY ARE THOSE OF THE SUGGESTED STANDARD. 

25 LONGITUDINAL CORE TYPE 

0 NOT LONGITUDINAL INTERNATONAL.CORE 

1 LONGITUDINAL INTERNATIONAL CORE 

27 STRATUM FOR CROSSSECTIONAL FORM CONSTRUCTION 

1 ARITHMETIC 

2 ALGEBRA 

3 GEOMETRY 

1» PROBABILITY AND STATISTICS 
5 MEASUREMENT 

29 STRATUM FOR LONGITUDINAL FORM CONSTRUCTION 

1 FRACTIONS 

2 RATIO PROPORTION PERCENT 

3 ALGEBRA 
1» GEOMETRY 

5 MEASUREMENT 

6 INTEGERS (NOT IN INTERNATIONAL CORE) 

7 PROBABILITY AND STATISTICS (NOT IN 
INTERNATIONAL CORE) 

31-32 SUBTEST CODE 1 
3'<-35 SUBTEST CODE 2 

• • • 

79-80 SUBTEST CODE 17 

THESE ARE THE SUBTESTS DEFINED IN MEMORANDUM A/369, 
WITH CORRECTIONS. THE NUMBER OF SUBTEST CODES PER 
ITEM VARIES. THE FOLLOWING SUBTEST CODES ARE USED. 



01 


ESTIMATION AND 


26 


PLANE FIGURES 




APPROXIMATION 


27 


COORDINATES 


02 


NEW MATHS IN 1ST STUDY 


28 


INFORMAL TRANSFORMATIONS IN 


03 


BASIC SKILLS 




GEOMETRY 


04 


ALGEBRA (COMPUTATION) 


29 


GEOMETRY 


05 


CALCULATOR USE 


30 


GEOMETRY (COMPUTATION) 


06 


ARITHMETIC (COMPUTATION) 


31 


GEOMETRY (OTHER THAN 


07 


PROPORTIONATE THINKING 




COMPUTATION) 


08 


ANCHOR ITEMS 


32 


REPRESENTATION OF DATA 


09 


WHOLE NUMBERS 


33 


(NOT USED) 


10 


COMMON FRACTIONS 


3'» 


PROBABILITY AND STATISTICS 




11 COMMON FRACTIONS 
(COMPUTATION) 



35 PROBABILITY AND STATISTICS 
(OTHER THAN COMPUTATION) 
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12 DFCTMAL FRACTTOMS 




^TAKinADPi TIKITTQ HP MrACTtDr 


1^ RATIO AND PROPORTION 


0 f 


nrTCDM 1 MATTTiKI HP MrACTtDr? 
ULlLnniNHl i\m Uf nLAoUnLo 


111 PERChiJ'^ 


jO 


MrAQTIDPMrKIT 


1*5 ARTTHMFTTC 


■50 


MPAQItDrMPKIT ^ rnMCTITATTHKI \ 
riLH^UnLriLN i \ UUrlrU 1 Hi i\JVi ) 


16 ARITHMETIC (OTHER THAN 




PiLH^UnLnLIM J VvinLn inHN 


rOMPIITATTON^ 




^Urir U i H i 1 UN ; 


17 TNTFCFR^ 


ill 


DDnQAQTT TTV AKIH CTATTQTTPC 
rnUOHOlLlil HViV ^iHiloilU^ 


18 'FORMULAS AND ALGEBRAIC 




( rOMPTIT ATT OM ^ 


EXPRESSIONS 


U2 




1Q EOUATIONS AND TNFOUATTONS 


*♦ J 




20 ALGFRRA 


nil 


VPDQAT 
VLnOHL 


21 ALGFRRA (OTHER TH^N 






rnMPTITATTON^ 




AMPUnD /VP DO AT \ 


22 CLASSIFICATION OF PLANE 


47 


DIAGRAMMATIC ITEMS (PAIRED 


FIGURES 




WITH NON-DIAGRAMMATIC) 


23 PROPERTIES OF PLANE FIGURES 


48 


NON-DIAGRAMMATIC ITEMS 


2k CONGRUENCE OF PLANE FIGURES 




(PAIRED WITH DIAGRAMMATIC) 


25 SIMILARITY OF PLANE FIGURES 







NATIONAL LINES (1 PER EACH OF EIGHT COUNTRIES, IN ORDER 
15/BFL, 22/BC, 25/ONT, 40/FRA, 
5VJPN, 63/NZ, 79/THA, 81 /USA) 



3-8 PERCENT RIGHT PRETEST 

9-14 PERCENT WRONG PRETEST 

15-20 PERCENT OMIT PRETEST 

23-28 PERCENT RIGHT PGSTTEST 

29-34 PERCENT WRONG POSTTEST 

35-40 PERCENT OMIT POSTTEST 

NOTE THAT "-1" IS CODED WHEN ITEM RESPONSE INFORMATION IS 
NOT AVAILABLE. 
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27.1 


1.7 


22.2 


3.5 


26.2 


0.6 


17.1 


3.H 


15.8 


0.9 


35.6 


1.2 


36.3 


0.2 


29.6 


0.6 



PARTIAL LISTING OF THE INTERNATIONAL ITEM RESPONSE FILE 

001 (22 • 18) - (U7 * 59) IS EQUAL TO 

1 001 1 1 0 20 2 3'i 0 1 6 03 05 06 08 09 15 H5 

73.0 2i<.5 2.5 71. k 
-1.0 -1.0 -1.0 7H.3 
78. «l ?0.8 0.8 73.2 

72.5 19. 8.0 79.6 
-1.0 -1.0 -1.0 83.3 

65.2 33.5 1.2 63.2 
59.7 38. H 2.0 63. 

69.3 29.1 1.6 69.7 

002 MATCHSTICKS ARE ARRANGED AS FOLLOWS. IF THE PATTERN IS 

2 001 3 0 0 31 12 0 1 6 09 15 16 
53.7 H3.0 3.3 55.5 '<1.9 2.6 
-1.0 -1.0 -1.0 51.8 '<5.8 2.H 
^2.7 53.5 3.8 1|6.8 51.3 1.9 
57.7 3'<.9 7.il 60.8 3'<.6 '<.6 

58.1 H0.5 l.ii ez.H 37.0 0.6 
'18.8 U9.f 1.7 50.4 48.2 1.4 

33.1 63. 3.1 36.7 61.5 1.8 

37.6 59.7 2.7 43.3 55.5 1.2 

003 2/5 * 3/8 IS EQUAL TO 

5 002 1 1 0 17 0 31 1 1 1 03 06 08 10 11 15 43 H5 

51.2 46.8 2.1 78.3 20.2 1.5 
66.9 31.6 1.5 72.1 26.4 1.5 
58.2 40.7 1.1 63.6 35.6 0.7 

'».5 77.9 17.6 73.4 24.6 2.0 

84.2 15.2 0.6 89.2 10.4 0.3 

29.0 70.3 0,7 39.0 60.2 0.8 
28.1* 70.6 0.9 48.0 51.8 0.2 
'J4.8 54.5 0.8 61.5 37.9 0.6 

004 WHICH OF THE FOLLOWING IS A PAIR OF EQUIVALENT FRACTIONS? 
4 002 2 0 0 ' 

86.7 11.9 
-1.0 -1.0 

81.6 17.3 
'•3.5 22.7 
-1.0 -1.0 
58. C 39.4 

62.7 35.9 

72.4 26.5 

005 0.40 » 6.38 

3 003 1 1 0 18 0 26 0 1 1 03 05 06 08 12 15 45 

64.8 32.1 
54.8 U0.2 

60.1 37.0 

70.3 24.9 
-1.0 -1.0 
35.7 62.4 
'0.6 59.2 



14 3 


3 0 11 


10 15 


16 


1.5 


90.3 


9.0 


0.7 


-1.0 


89.7 


9.0 


1.3 


1.1 


85.1 


14. 1 


0.9 


3:i.8 


82.6 


11.1 


6.3 


-1.0 


82.6 


16.5 


1.0 


1.9 


65.4 


33.9 


0.7 


1.4 


74.2 


25.4 


0.4 


1.1 


80.4 


19.3 


0.3 


IS EQUAL TO 






18 0 26 0 1 1 


03 05 


06 08 


3.1 


59.5 


37.4 


3.1 


5.0 


61.5 


34.7 


3.8 


2.9 


64.6 


34.2 


1.2 


4.7 


73.5 


24.5 


2.0 


-1.0 


62.8 


36.4 


C.8 


1.9 


40.3 


58.2 


1.5 


1.3 


49.6 


49.8 


0.6 
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52.1 l»5.^ 2.5 63.3 35.7 1.0 

• • • 



ERIC 



-37- i2 



Append li II, page 5 



LISTING OF FORTRAN PROGRAM USED TO OBTAIN THE 
INTERNATIONAL ITEM RESPONSE FILE 



c 
c 
c 
c 
c 
c 
c 



this program reads the cognitive item table and each of 
the student response file and produces an integrated table of 
item statistics, right-wrong-omit by pretest-posttest by country, 
with some item codes. The results will be accumulated in rwo, 
with sample sizes in sara. 



c 
c 
c 
c 



c 
c 
c 
c 

c 
c 
c 
c 
c 
c 



integer p,q,r,c,u,v 
character*!? id 
character*! xxx 
dimension rwo( !99,3,2,8) 
character*3 place(8) 

data place / 'bfr , 'be' , 'onf , 'fra' , ' Jpn' , 'nz \ 'tha* , ' usa V 

the following table shows the ndes(form, time, country), 
the number of items per form by time and country 

dimension ndes(2,2,8) 
data ndes 

/^0,35,i<0,35, 
^0, 0,iJ0,35, 
^0,35,ilO,35, 
^0,35,ilO,35, 
60, 0,110, 3^ 
^0,35,ilO,35, 
^0,35,ilO,35, 
^0,35,ilO,35/ 

the following arrays will hold a response data set for one 
student, including the availability and form keys 

dimension kab(3,2),inp(60,2,2) 

The following arrays store what is read from the cognitive 
item table. 

imap(p,q,j,c) will indicate where to put tabulations for item p 
in form q at time j for country c. 



dimension key( 199) 
character*3 hun( i99) 
character*76 itlab(199) 
character*?^ itcode(!99) 
dimension imap(60,5,2,8) 
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c 

c clear out the maps 
c 

do cs1,8 
do ps1,60 
do q^l ,5 
do J=1,2 
imap(p,q, J,c)sO 
enddo 
enddo 
enddo 
enddo 

c 

c read and store cit data input 
c 

open(unit=22 , files ' document : table . cog ' , status= ' old ' , 
1 readonly ) 
do ir 1,199 

c 

c read the international information 
c 

read(22,20)hun(i),itlab(i),key(i),itcode(i) 
20 format(a3, 1x,a/4x,i1 , 1x,a) 

c 

c read the national information, making a special case of Japan, 

c which has a non-standard pretest 

c 

do cs1,8 

if( c.ne.5 ) read(22,30)ifrm,ipos,ia1,ia2 

if( c.eq.5 ) read(22,30)ifrm,ipos,ia1,ia2,Jfrm,Jpos 

3P format(2x,i2,i3,5x,i1,3x,i1,2x,i2,i3 ) 

c 

c che( application codes and count anything other than 

c ^ or , unusable. For the pretest, making Japan 
c a special case. • . 
c 

if( ial.ge.l* ) then 
if( c.eq.5 ) then 

pr(Jfrm-1)*20*Jpos 
imap(p,1,1,c)si 

else 

imap(ipos,ifrm*1, 1 ,c)5i 
endif 
endif 

c 

c for the posttest . . . 
c 

if( ia2.ge.4 ) then 

imap( ipos,ifrm*1 ,2,c)si 
endif 

enddo 
enddo 
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c 

c loop through the data files, opening the input and clearing the 

c accumulators 

c 

do c=1,8 
type c 

open(unit=20, files • student :all . ' //place(c) , 
1 status: ' old ' , readonly ) 

do i=1,199 

do J=1,2 
do k=1,3 

rwo(i,k,J,c)=0 

enddo 

enddo 

enddo 

c 

c now read the data and score and aggregate, making a special 
c skip for the USA student OTL data 

0 

110 read(20,120,end=200)id,kab 
120 format(a17,6i1////) 
do J=1,2 

do k=1,2 

if( ndes(k,J,c).ne.O ) read(20,130) 
1 (inp(p,k,J),p=1,ndes(k,J,c)) 
130 format(6x,60i1) 

if( c.eq.8 .and. k.eq.1 ) read(20, I40)xxx 
1^*0 format(al) 

enddo 

enddo 
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c 

c insist on a complete pretest and posttest (in BC, there is no 
c pretest rotated form) 

c in this loop, J is time pre or post, k is form core or rotated 
c in the US, throw out the supplementary samples and Hartford 
c 

if( kab(1,1).eq.3 .and. kab( 1 ,2) .eq.3 .and. kab(2,2) .eq.3 
1 .and. (kab(2,l).eq.3 .or. c.eq.2 ) 

1 .and. (c.ne.8 .or. id(5:5).ne. '3' .and. 

1 (id(9:9).eq.'r .or. id(9:9) .eq. '2^ ) ) then 

do Jrl,2 

do kri,2 

nn=ndes(k, J,c) 
if( nn.ne.O ) then 
kk::1 

if(k.eq.2)kk=kab(3 J)*1 

do psl,nn 

ii=imap(p,kk,J,c) 
if( inp(p,k, J).eq.key(ii) ) then 
v=1 

elseif( inp(p,k J).gt.5 ) then 
v=3 

else 

v=2 
end if 

rwo(ii,vJ,c)=rwo(ii,v J,c)*1 
enddo 
endif 
enddo 
enddo 
endif 
goto 110 

c 

c close the file and loop 
c 

200 close(unitr20) 
enddc 
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c now write out the results 
c 



open(unit=1,fiie.-'iongtab.out',status='neW, 
' carriagecontrols'list' ) 

do is 1,199 

do c=1,8 
do J=1,2 

sam=rwo(i,1j c)*^wo(i,2,J,c)-^^wo(i,3.J,c) 
if( sam.eq.O ) then 

do v=1,3 

r'wo(i,v,J,c)=-1 
enddo 

else 

do v:1,3 

1 rwo(i,v,J,c)=100»rwo(i,v,j,c)/ 

san 

enddo 

end if 

enddo 

p?n "fite(1,220)((rwo(i,v, 1,c),v=1 V 1=1 2) 

forn>at(2x,3f6.1,2x,3f6.i) 
enddo 

enddo 

end 
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Page 1 File layout 

Page 2 Partial list jig of file (COMBO.USA) 
Pages 3-8 Usting cf SPSS-X setup (COMBO.SPS) 



48 

-A3- 



Appendix III, page 1 

LAYOUT OF COMBO. USA FILE 

A. There are seven lines per clas&room. 

B. The first line is labeled "ID" and contains 

3-i| sampling stratum 

5-7 school number 

8-9 classroom number within school 

10- m number of students with complete pretest and posttest 

C. The second line is labeled "TEA" and contains, in format (6x,Hf6.0), 

Gender of the teacher 
Age of the teacher 

Response by teacher to question of differentiating 
assignments (from the teacher background questionnaire) 
- Special coding of USA class types (see USA national report) 

Missing data are coded -1. 

D. The third line contains two sets of OTL summaries the first h»„in» 
to do with OTL before the target year, the second'witS m in the 
target year, in each set the content scales are: 

ARITHall arithmetic except ratio-proportion-percent 
RPP ratio-proportion-percent 
ALG algebra 
GEOM geometry 

PANDSprobability and statistics 
MEAS measurement 

The format is (6x,12f6.1) and missing data are coded -1. 

E. The fourth line contains two sets of achievement results, pretest and then 
posttest for the same six content areas. These are mean^ fn the metric 
d[ff!^«ni;L°J regression calibrations have been mide fJr 
weighting of the total score. The centres are arbitrary. For relational 
Trill'''.''' appropriate to regress each postLst mean on SSe 
corresponding pretest mean and on teacher and classroom variables See 
Burstein and Wolfe (Epilogue paper) for details. -f-^aD^es. iee 

fJrnV:;}L!nTdat:."''' "'^'^'^ '^'^ there 



F. 



The fifth through seventh lines are labeled "CPG" and contain the eeneral 
classroom process questionnaire, in the layout of the databank 

Mis'iing data are blank, indicating there was no general questionniare 
or are coded "9", as in the international codebooks. '^"""^""iare. 
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ID 1 11 1 20 

TEA 2 33 2 2 

OTL 16.0 0.0 0.0 5.0 61.0 15.0 71.0 82.0 72.0 33.0 17.0 5H.0 

ACH 46.5 53.3 42.4 43.9 43.4 46.3 62.0 63.8 44.3 54.4 75.4 66.0 

CPG 232 122 1 1 1 2022 1 0000000000000002222 1 1 0 1 1 00 1 003023222 1 3 1 22070000 

CPG 0300002223121223233333391210120070020002323232432423334444323 

CPG 3224323134433223343 2122 

ID 1 11 2 19 

TEA 1 31 2 2 

OTL 0.0 0.0 3.0 0.0 22.0 4.0 82.0 94.0 81.O 33.0 28.0 65 0 

ACH 38.2 41.9 34.3 35.0 34.4 37.8 65.1 49.5 55.9 39.4 68.8 57.3 

CPG 231 1 1 1 122222121001 1002100120022221 1221 1 1 122322333222222060020 

CPG 020000 1 1 2 1 22 1 2 1 32323333322 1 0 1 90020000003334443343334433223434 

CPG 4433324333434233334 2222 

ID 1 36 1 28 

TEA 1 47 3 3 

OTL 0.0 0.0 0.0 0.0 0.0 15.0 98.0 100.0 94.0 76.0 100.0 85.0 

ACH 34.0 38.1 30.4 31.2 31.2 33.2 47.5 47.9 40.0 39.4 62.2 49.9 

CPG 1 2222 1121 99999999999999999999999999999999 1141 0430222322 100000 

CPG 000000222 1 1 22223 1 3 1 333390 1 1 03 1 000000000 1 4944422344243342 14412 

CPG 4232324213444142424 2112 

ID 1 36 2 20 

TEA 1 47 2 1 

OTL 0.0 0.0 6.0 0.0 0.0 27.0 89. 0 94.0. 53.0 14.0 78.0 46.0 

ACH 19.9 23.4 18.6 19.3 19.8 21.3 23.4 16.9 27.7 21.8 39.2 27.8 

CPG 111 12223191 19299999999999999992229999999901400420422202080000 

CPG 0200002222122213122333391210240060000001224449244434344442414 

CPG 4232313122444132444 2112 

ID 1 40 1 24 

TEA 2 32 2-1 

OTL 53.0 71.0 3.0 48.0 33.0 77.0 31.0 29.0 94.0 10.0 28.0 0.0 

ACH 53.0 59.0 46.3 47.2 46.8 49.0 73.8 62.5 79.7 60.2 72.1 70.0 

CPG 1 1 1 1 121312221 1 1 1 1000000001 12222221 1 11111 100301232324322070015 

CPG 0150002221122212222333291220230010000002424443442334434444423 

CPG 3433314443433243413 2112 

ID 1 40 2 26 

TEA 1 34 3 4 

OTL 22.0 12.0 3.0 0.0 56.0 46.0 56.0 88.0 69.0 5.0 6.0 0.0 

ACH 41.4 45.8 36.1 36.9 36.9 39.6 59.8 46.9 56.5 48.4 63.8 52.4 

CPG 132111121 2222 1 00000000000 1 1 222222 1111 0000 1 34 1 2442402 1 30085000 

CPG 0 1 5000222 1 1 2229999999999 1 1 1 02800 1 00 10002224443434434444334443 

CPG 4433433434444233344 1211 

ID 1 67 1 14 

TEA 2 51 3 3 

OTL 0.0 0.0 0.0 0.0 0.0 0.0 91.0 88.0 50.0 52.0 100.0 88.0 

ACH 30.0 36.0 28.2 29.1 29.8 30.7 39.2 28.1 29.0 32.7 58.7 51.4 

CPG 232 1 22 1 32 1 2222 1 1 0000000000 1 0 1 0000000000000003 1 0224344 1 1 050000 

CPG 0500002221 122223231 133391 1 10170050000001 123232324424243223443 

CPG 2432114412244134214 2112 
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LISTING OF SPSS CONTROL FILE 



title 'Input and distributions of U.S.A. COMBO file' 
file handle combo / names 'databank: combo. usa' 
data list file=combo records=7 
/I 

QSTRAT QSCHOOL QCLASS QTEACHER NPREPOST 

(2x,f2.0,f3.0,f2.0,f3.0,f5.o) 

/2 

TSEX TAGE TDIFASG CLASTYPE 

(6x,Hf6.0) 

/3 

OLDARITH OLDRPP OLDALG OLDGEOM OLDPANDS OLDMEAS 
NEWARITH NEWRPP NEWALG NEWGEOM NEWPANDS NEWMEAS 
(6x,12f6.1) 
/K 

XARITH XRPP XALG XGEOM XPANDS XMEAS 
YARITH YRPP YALG YGEOM YPANDS YMEAS 
(6x,12f6.1) 



/5 

C08JL0G 
COBJCOM 
CSISYLG 
CSIMIND 
CSIJRNP 
CSISLFA 
CSIPROP 
CDWADVA 
CDWMEME 
CGRPOTH 
CHDHARD 
CPGTIME 
CTMATH 

CESIMP CEPRSE 
CF'^UM CESTRC 
CELONG CEDSCV 
CECALL CESPWK 
CETRDIF CERVTST 
CEIDENT CEGAPT 



COBJPRF COBJINT 
COB JSC I COBJSYS 
CSISYLD 



CSISYLP 
CSIMINA 
CSljRND 
CSIOTHG 
CSIPROD 
CDWTSLF 
CDWADVT 



COBJLIF 
CSITXTD CSITXTA 
CSIMINP 

CSIEXTA CSIJRNG 
CSISLFD 
CSIPROG 
CDWPSLF CDWTPUB 



COBJKNW COBJINQ 
CSITXTG CSITXTP 
CSISYLA CSIMING 
CSIEXTG CSIEXTP CSIEXTD 
CSIJRNA CSISLFG CSISLFP 
CSIOTHP CSIOTHD CSIOTHA 
CSIPROA CDWVPUB CDWVSLF 
CDWTEXT CDWWBK CDWEXP CDWSYL CDWMEMM 
CDWEXAM CGRPWHL CGRPSMA CGRPIND 
CSGMAB CSGLAB CSGMANY CPACING CDASSGN CHDMORE 
C"?'£°L "GABIL CPGMISB CPGINDF CPGFEAR CPGABS 
CPGPROF CPGLIM CPGMANY CPGOTH CFEAR CTCLASS 
CTCATT CTCNATT CTCBEHV CTCOTH CETALK CECOMPT 
CETRAN CERMRK CECHNG CEHPROB CECORRF 
CEACT CERULE CEVARY CEFEED CEPREV CEWARM 
CERDY CEOUTLN CELVLY CEANTCQ CECRIT 
CECMMNT CEGIRLS CEFOOL CESAYGD CEVRTY 
CEFORST CEKNDO CESTPRF CESTOP CETAIL 
CESTEP 



(6x,55f1.0,2f3.0 / 6x,2f3.0,21f1.0,4f3.0,22f1.0 / 6x,19fl 



0) 



missing values COBJLOG to CDWEXAM, CSGMAB to CTMATH, CETALK to CESTEP ( 
CGRPWHL to CGRPOTH, CTCATT to CTCOTH (999) * 
TSEX, TAGE, TDIFASG, CLASTYPE (-1) 
OLDARITH to NEWMEAS (-.1) 
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variable labels 

NPREPOST 'NUMBER OF STUDENTS WITH PRE AND POSTTEST' 

TSEX 'GENDER OF THE TEACHER' 

TAGE 'AGE OF THE TEACHER' 

TDIFASG ; DIFFERENTIATED EXERCISES ASSIGNMENTS' 

CLASTYPE 'U.S.A. TYPE OF CLASSROOM' 

OLDARITH 'PRIOR OTL IN ARITHEMETIC 

OLDRPP 'PRIOR OTL IN RATIO PROP. PERCENT' 

OLDALG 'PRIOR OTL IN ALGEBRA' 

OLDGEOM 'PRIOR OTL IN GEOMETRY' 

OLDPANDS 'PRIOR OTL IN PROB. AND STATS.' 

OLDMEAS 'PRIOR OTL IN MEASUREMENT' 

NEWARITH 'THIS YEAR OTL IN ARITHEMETIC 

NEWRPP 'THIS YEAR OTL IN RATIO PROP. PERCENT' 

NEWALG 'THIS YEAR OTL IN ALGEBRA' 

NEWGEOM 'THIS YEAR OTL IN GEOMETRY' 

NEWPANDS 'THIS YEAR OTL IN PROB. AND STATS.' 

NEWMEAS 'THIS YEAR OTL IN MEASUREMENT' 

XARITH 'PRETEST IN ARITHEMETIC 

XRPP 'PRETEST IN RATIO PROP. PERCENT' 

XALG 'PRETEST IN ALGEBRA' 

XGEOM 'PRETEST IN GEOMETRY' 

XPANDS 'PRETEST IN PROB. AND STATS.' 

XMEAS 'PRETEST IN MEASUREMENT' 

YARITH 'POSTTEST IN ARITHEMETIC 

YRPP 'POSTTEST IN BATIO PROP. PERCENT' 

YALG 'POSTTEST IN ALGEBRA' 

YGEOM 'POSTTEST IN GEOMETRY' 

YPANDS 'POSTTEST IN PROB. AND STATS.' 

YMEAS 'POSTTEST IN MEASUREMENT' 

COBJLOG 'Q.I. A OBJTV.. LOGICAL STRUCTURE OF MATH' 

COBJPRF 'Q.1.B OBJTV.. THE NATURE OF PROOF' 

COBJINT 'Q.1.C OBJTV.. INTEREST IN MATHEMATICS' 

COBJKNW 'Q.1.D OBJTV.. KNOW MATH FACTS, ETC 

COBJINQ 'Q.1.E OBJTV.. ATTITUDE OF INQUIRY' 

COBJLIF 'Q.1.F OBJTV.. AWARENESS OF MATH IN LIFE' 

COBJCOM ' Q . 1 . G OBJTV . . COMPUTATION SPEED ACCURACY ' 

COBJSCI 'Q.1.H OBJTV.. AWARENESS OF MATH IN SCIENCE 

COBJSYS 'Q.I.I OBJTV.. SYSTEMATIC APPROACH PROBLEMS 

CSITXTG 'Q.2.A1 GOALS SOURCE. .TEXTBOOK' 

CSITXTP 'Q.2.A2 PRESENT. SOURCE. .TE;;CTB00K' 

CSITXTD 'Q.2.A3 DRILL SOURCE. .TEXTBOOK' 

CSITXTA 'Q.2.A1I APPLCT. SOURCE. .TEXTBOOK' 

CSISYLG ' Q . 2 . B 1 GOALS SOURCE . . SYLLABUS ' 

CSISYLP 'Q.2.B2 PRESENT. SOURCE. .SYLLABUS' 

CSISYLD 'Q.2.B3 DRILL SOURCE. .SYLLABUS' 

CSISYLA 'Q.2.B1I APPLCT. SOURCE. .SYLLABUS' 

CSIMING 'Q.2.C1 GOALS SOURCE.. MIN COMPETENCIES' 

CSIMINP 'Q.2.C2 PRESENT. SOURCE.. MIN COMPETENCIES' 

CSIMIND 'Q.2.C3 DRILL SOURCE.. MIN COMPETENCIES' 

CSIMINA 'Q.2.C1I APPLCT. SOURCE.. MIN COMPETENCIES' 
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CSIEXTG 

CSIEXTP 

CSIEXTD 

CSIEXTA 

CSIJRNG 

CSIJRNP 

CSIJRND 

CSIJRNA 

CSISLFG 

CSISLFP 

CSISLFD 

CSISLFA 

CSIOTHG 

CSIOTHP 

CSIOTHD 

CSIOTHA 

CSIPROG 

CSIPROP 

CSIPROD 

CSIPROA 

CDWVPUB 

CDWVSLF 

CDWPSLF 

CDWTPUB 

CDWADVA 

CDWTSLF 

CDWTEXT 

CDWWBK 

CDWEXP 

CDWSYL 

CDWMEMM 

CDWMEME 

CDWADVT 

CDWEXAM 

CGRPWHL 

CGRPSMA 

CGRPIND 

CGRPOTH 

CSGMAB 

CSGLAB 

CSGMANY 

CPACING 

CDASSGN 

CHDMORE 

CHDHARD 

CHDTOP 

CPGABIL 

CPGMISB 

CPGINDF 

CPGFEAR 



•Q 
'Q 
•Q 
•Q 
•Q 
•Q 
'Q 
•Q 
•Q 
•Q 
'Q 
•Q 
•Q 
•Q 
'Q 
•Q 
'Q 
'Q 
'Q. 
'Q. 
'Q. 
'Q. 
'Q. 
'Q. 
'Q. 

•Q. 

•Q. 

'Q. 

'Q. 

'Q. 

•Q. 

'Q. 

'Q. 

'Q. 

'Q. 

'Q. 

'Q. 

•Q. 

•Q. 

•Q. 

•Q. 

'Q. 

•Q. 

•Q. 

•Q. 

•Q. 

'Q. 

'Q. 

•Q. 

'Q. 



.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.2 
.3 
.3 
.3 
.3 
.3 
.3 
.3 
.3 
.3 
.3 
3 
3 
3 
3 
H. 
H. 
H. 
H. 
5. 
5. 
5. 
6 
7 
8. 
8. 
8. 
9. 
9. 
9 
9 



.D1 GOALS SOURCE.. EXTERNAL EXAMS' 
.02 PRESENT. SOURCE. .EXTERNAL EXAMS' 
.03 ORILL SOURCE.. EXTERNAL EXAMS' 
.DH APPLCT. SOURCE.. EXTERNAL EXAMS' 
.El GOALS SOURCE.. JOURNALS, BOOKS' 
.E2 PRESENT. SOURCE. .JOURNALS, BOOKS' 
.E3 ORILL SOURCE.. JOURNALS, BOOKS' 
.Ell APPLCT. SOURCE.. JOURNALS, BOOKS' 
.F1 GOALS SOURCE.. BY YOURSELF' 
.F2 PRESENT. SOURCE.. BY YOURSELF' 
.F3 ORILL SOURCE.. BY YOURSELF' 
.Fl| APPLCT. SOURCE.. BY YOURSELF' 
.G1 GOALS SOURCE.. OTHER TEACHERS' 
.G2 PRESENT. SOURCE. .OTHER TEACHERS' 
.G3 ORILL SOURCE.. OTHER TEACHERS' 
•GH APPLCT. SOURCE.. OTHER TEACHERS' 
.HI GOALS SOURCE.. PROF MEETINGS' 
.H2 PRESENT. SOURCE.. PROF MEETINGS' 
.H3 ORILL SOURCE.. PROF MEETINGS' 
.HH APPLCT. SOURCE.. PROF MEETINGS' 
•A OIFFICULTY WO. .PUBLISHEO VISUALS' 
.B OIFFICULTY WO.. VISUALS BY YOURSELF' 
.C OIFFICULTY WO.. PROBLEMS BY YOURSELF' 
OIFFICULTY WO.. PUBLISHEO TESTS' 
OIFFICULTY WO..A0VICE FROM AOMIN' 
OIFFICULTY WO. .TESTS BY YOURSELF' 
OIFFICULTY WO.. PUBLISHEO TEXTBOOKS' 
H OIFFICULTY WO. .PUBLISHEO WORKBOOKS' 
.1 OIFFICULTY WO.. EXAMPLES MAOE UP' 
J OIFFICULTY WO.. OFFICIAL SYLLABUS' 
K OIFFICULTY WO.. REMEMBER FROM MATH' 
L OIFFICULTY WO.. REMEMBER FROM EOUC 
M OIFFICULTY WO..A0VICE FROM TEACHERS' 
N OIFFICULTY WO. .KNOWLEDGE OF EXAMS' 
A WHOLE CLASS WORKING AS A SINGLE GROUP' 
B SMALL GROUP INSTRUCTION' 
C ALL STUOENTS WORKING INOIVIOUALLY' 
0 OTHEft GROUPING ARRANGMENT' 
A MOST ABLE STUOENTS WORK SEPARATELY' 
B LEAST ABLE STUOENTS WORK SEPARATELY' 
C CLASS IS SPLIT INTO 3 OR MORE GROUPS' 
SAME OR VARIEO CONTENT OR PACING' 
SAME OR VARIEO EXERCISES ANO PROBLEMS' 
A SOME ST0S..MORE EXERCISES' 
B SOME ST0S..MORE DIFFICULT EXERCISES' 
C SOME STOS.. OTHER TOPICS' 
A PROGRESS. .STUDENT LACK OF ABILITY' 
B PROGRESS.. STUDENT MISBEHAVIOUR' 
C PROGRESS.. STUDENT INDIFFERENCE' 
0 PROGRESS.. FEAR OF MATHEMATICS' 
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CPGABS 'Q.9.E PROGRESS. .STUDENT ABSENTEEISM' 

CPGTIME 'Q.g.F PROGRESS.. INSUFFICIENT SCHOOL TIME' 

CPGPROF 'Q.9.G PROGRESS. .PROFICIENCY ON YOUR PART' 

CPGLIM '0.9. H PROGRESS.. LIMITED RESOURCES' 

CPGMANY 'Q.9.I PROGRESS.. TOO MANY STUDENTS' 

CPGOTH 'Q.9.J PROGRESS.. OTHER REASONS' 

CFEAR 'QIO. STUDENTS ESPECIALLY FEARFUL ANXIOUS' 

CTCLASS 'Q11. TARGET CLASS EASY OR DIFF. TO TEACH' 

CTMATH 'Q12. DO YOU FIND MATH EASY DIFF. TO TEACH' 

CTCATT 'Q13.A TARGET CLASS. .ATTENTIVE' 

CTCNATT 'Q13.B TARGET CLASS.. NOT ATTENTIVE' 

CTCBEHV 'QI3.C TARGET CLASS. .BEHAVIOUR PROBLEMS' 

CTCOTH 'QI3.D TARGET CLASS.. OTHER KINDS' 

CETALK W^.y TALK TO INDIVIDUAL STUDENTS'* 

CECOMPT 'QMi.2 STIMULATE COMPFTITION' 
CESIMP GIVE LESS ABLE SIMPLE ASSGNMNTS' 

CEPRSE 'Q1H.1* PRAISE STUDENTS WHO ARE CORRECT' 
CETRAN PLAN TRANSITIONS' 

CERMRK 'Qyii.e MAKE ENCOURAGING REMARKS' 

CECHNG 'Q1H.7 CHANGE ACTIVITY IF NO ATTENTION' 

CEHPROB 'QUI. 8 MORE ABLE GET HARDER PROBLEMS' 

CECORRF 'QMi.9 IMMDTLY CORRECT FALSE STATMNTS' 

CESUM 'Q1H.10 SUMMARIZE AT END OF PERIOD' 

CESTRC 'Q1il.11 PRESENT HIGHLY STRUCTURED' 

CEACT 'Q1H.12 ACTION TO DEAL WITH DISCOMFORT' 

CERULE 'QIH.I3 CLEAR. CUT RULES FOR BEHAVIOUR' 

CEVARY 'Q^^.^^ vary the difficulty of questions' 

CEFEED 'QIH.15 frequent INDIVIDUAL FEEDBACK' 

CEPREV 'QMi.^6 CLEAR UP PREVIOUS PROBLEMS' 

CEWARM 'QIH.I7 WARM, PERSONAL RELATIONSHIPS' 

CELONG 'QUI. 18 ALLOW DISCUSSIONS TO GO LONGER' 

CEDSCV 'QIH.I9 OPPORTUNITY FOR DISCOVERY' 

CERDY 'Q1i|.20 GET READY BEFORE CLASS' 

CEOUTLN 'Ql'1.21 AT BEGINNING OUTLINE CONTENT' 

CELVLY 'Q1H. 22 MAKE PRESENTATIONS LIVELY' 

CEANTCQ 'QMi.23 TRY TO ANTICIPATE QUESTIONS' 

CECRiT 'Q^^.2^ avoid critical about answers' 

CECALL 'QMi.25 CALL ON WHO DO NOT VOLUNTEER' 

CESPWK 'Q11I.26 DETERMINE SPECIFIC WEAKNESSES' 

CECMMNT 'Ql'1.27 WRITE MEANINGFUL COMMENTS' 

CEGIRLS 'Q1H.28 SPECIAL ENCOURAGMEIJT TO GIRLS' 

CEFOOL 'QMi.29 INTERVENE WHEN FOOLING AROUND' 

CESAYGD 'Ql'1.30 SAY SOMETHING GOOD ABOUT ANSWERS' 

CEVRTY 'QU.^y CHANGE FOR SAKE OF VARIETY' 

CETRDIF 'Q1'<.:?2 SOME TRUELY DIFFICULT PROBLEMS' 

CERVTST 'Q1H.33 REVIEW TESTS AFTER GRADING' 
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CEFORST -QU.SM FORSTALL STUDENT DISTURBANCES' 

CEKNDO 'Q11I.35 STUDENTS KNOW WHAT SHOULD DO' 

CESTPRF '014.36 STUDENT PREFERENCES INTO ACCOUNT' 

CESTOP 'QU.37 STOP MATTERS NOT CLOSELY RELATED' 

CETAIL '014.38 GIVE TAILORED ASSJ'-.NMENTS' 

CEIDENT 'QU.39 IDENTIFY STUDENTS IN DIFri.ULTy 

CEGAPT 'QU.HC MATH APPROPRIATE FOR GIRLS' 

CESTEP '014. 41 STEP BY STEP INSTRUCTIONS' 



value labels TSEX 

1 'FEMALE' 

2 'MALE' 

/TDIFASG 

1 'FREQUENTLY' 

2 'OCCASIONNALLY' 

3 'RARELY OR NEVER' 

/CLASTYPE 

1 'REMEDIAL' 

2 'REGULAR' 

3 'ENRICHED' 
1} 'ALGEBRA' 

/COBJL^:: to COBJSYS 

1 'RELATIVELY MORE' 

2 'ABOUT EQUAL' 

3 RELATIVELY LESS' 

/CSI'iXTG to CSIPROA 

0 'NEVER USED' 

1 'OCCSNLLY USED' 

2 'FREQUENTLY USED' 

/CDWVPUB to CDWEXAM 

1 'VERY EASY' 

2 'FAIRLY EASY' 

3 'FAIRLY DIFFICULT' 
i» 'VERY DIFFICULT' 

0 NOW DO WITHOUT' 

/CSGMAB to CSGMANY 

1 'YES' 

2 'NO' 

3 'NONE REGULARLY' 

/C PACING 

1 'SAME CNTNT PACE' 

2 'VARY PACE' 

3 'VARY CONTENT' 

/CDASSGN 

1 'SAME' 

2 'VARY DATE CMPLTN' 

3 'VARY EXERCISES' 

/CHDMORE to CHDTOP 

1 'YES' 

2 'NO' 
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/CPGABIL to CPGOTH 

1 'VERY IMPORTANT' 

2 'SOMEWHAT IMPRTNT' 

3 'NOT IMPORTANT' 

/CFEAR 

0 'NONE' 

1 'ONE to THREE' 

2 'FOUR to SIX' 

3 'SEVEN to NINE' 
H 'TEN OR MORE' 

/CTCLASS 

1 'VERY EASY' 

2 'FAIRLY EASY' 

3 'NEUTRAL' 

M 'FAIRLY DIFFICULT' 
5 'VERY DIFFICULT' 
/CTMATH 

1 'VERY EASY' 

2 'FAIRLY EASY' 

3 'NEUTRAL' 

H 'FAIRLY DIFFICULT' • 
5 'VERY DIFFICULT' 

/CETALK to CESTEP 

1 'LIL OR NO IMPORT' 

2 'SOME IMPORT' 

3 'MAJOR IMPORT' 

1» 'HIGHEST IMPORT' 

condescriptive OLDARITH to YMEAS 

CGRPWHL to CGRPOTH, CTCAH to CTCOTH 
frequencies variables s TSEX, TAGE. TDIFASG, CLASTYPE 

COBJLOG to CDWEXAM, CSGMAB to CTMATH, CETALK to CESTEP 
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Appendix IV. Extracts from the Databank 

Pages 1-2 Directories 

Pages 3-6 Student, teacher, and school data files 

Page 7 TABLE.COG, Cognitive item table 

Page 8 TABLE.QUS, Questionnaire item table 

Page 9 A.O, Documentation introduction 

Pages 10-13 A. 1 . Basic parameters and sizes 

Pages 14-17 A.2. Response data layout 

Pages 18-25 A.3. Cognitive item coding 

Pages 26-3 1 A.4, Questionnaire item coding 

Pages 32-36 A.5, Sampling notes and strata definitions 

Pages 37-40 A.6, Detailed coding and textual explanations. 
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$ datalink 



The Population A Longitudinal archive areas are: 
* databank' s top directory 
'school' s school data files 
'student' = student data files 
'teacher' s teacher/clajsroor data files 
'document' s data documentation files 
To see what is in an area, enter 'dir x' where *x is the name of the area. 
To refer to a archive file from your account, for typing, analysis, etc., 
prefix the file name with the area name and a colon, e.g., 'student :all .usa' . 



$ dir student 



Directory CSG : ( AMATHRGW . DATABANK . STUDENT] 


ALL.BCjl 


1698 


ALL.BFLjl 


2556 


ALL.FRA;1 


6860 


ALL.JPN;1 


6630 


ALL.NZ;1 


H521 


ALL.ONTjl 




ALL.THAjl 


3152 


ALL. USA; 2 


7552 


Total of 8 files, 37558 blocks. 


$ dir school 




Directory CSG: 


[ AMATHRGW . DATABANK . SCHOOL ] 


ALL.BC;1 


15 


ALL.BFL;1 


27 


ALL.FRA; 1 


30 


ALL.JPN;1 


3ii 


ALL.NZ;1 


17 


ALL. ONI; 1 


21 


ALL.THA;! 


16 


ALL. USA ;1 


26 



Total of 8 files, 186 blocks. 
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81 1 11 1 1 2 2 33'<33'< 
5001 11 58021 35223'<22221 

5201 1 165029999933'<'*99999999999928e988 18888832212 1312 

5202 23'<12'<32231'<322'<2232223'<3232'<313212'<'<33323212 

5203 31'<32'<K332122'<3'<3'<2153'<23'<3322'<W34'<3252252231'<3'<12133 

5101 2UK5'<'<'<25'<53323 1 1 1 '<2'<'<3 1'*55353 125^3 1 35 1 3 

5102 11311 11113131 11 11 1311111113111111 ■'119111 
5141 55 1 12'<3'<3335 1 3 1 532'* 1 3'*'* 1 15'<5'< 1** 1 552 

5301 2H3'<'<'<'<25'<5'<323 1 1 3'<2H53 1535353535 1 3'<5 1'<3 

5302 1131113119311111133111111111111311111111 
53'<1 5521 m3'<32321 325324 13'<'<513'<1 1 143152 

81 1 11 1 2 2 2 331331 
5001 215705333224333*24 

5201 216405999993444999999999999288888999999331 131111 

5202 2232232222342U42342222232232ii32222232232225 1 5 

5203 214321234543212345432123454432132133334333333332233333 

5101 11 344432543 1 33553322255 15 1 33525254343 1 15 

5102 1131113111331311131111111131111111113111 
5111 4 145 n 1 15352235424555 1 3223454334323 

5301 1234543212123454321234542234523454321244 

5302 1111131111131311131111131111111111111113 
5311 43354412335143212345432123454321234 

81 1 11 1 321 333000 
5001 115300114111212112 
5201 
5202 
5203 

5101 2l'355442524432552 1 32 1 53345 1 35232 1 3 1 244 1 4 

5102 1111111111111111111111111111111111111111 
5131 42432353143143432344525243254242431 

530 1 9999999999999999999999999999999999999999 

"5302 

539 1 99999999999999999999999999999999999 
81 1 11 1 4 2 2 332333 
5001 116805245135224124 

520 1 11 7505999994444999999999999 1 88983999999334 121141 

5202 12312U324424222424424444234212333433444343212 

5203 43221 423i;422242434U23422344224423422422234222444422334 

5101 5321552224334552341254124331541315343421 

5 102 9999999999999999999999999999999999999999 
5121 31153125311152155231151335143121312 

530 1 242 142 1 22223525232^254332 122535325353445 

5302 1111113311113131131313111331131311313111 
5331 43422132125435511434154443553412145 
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% type teacher :all.usa 



81 1111 12 0 0 0 0 1222222 

6001 23310 913 6 32520222229159 09 01021 5 U513531 602 9 9 3 0 

6002 1502U02803001201201?0120150150 30 30 60 60 75 75120120 30 30 

6003 ^^2 3 355599997251101101102 52U02U51 01 02312113315 
600:< 1 122131 112222U2W32UU22U5 

6 101 32 1 333233222323332229999999932992922992 1 99999999 1 1 99991 1 09 

6102 1199191 199119919119921999999993299999299329922229232999992923 

6103 3332222313312121999999991 1991 1 1 19132992992923299299292 

61OU 21999999993299299292313OU5OI8OIOIO30202030602OO2030102020306I 
6105 1U5512222UU2?2112 

6111 21 13332222222222231 1 1 1232299929921 19919191 1 1 199191 1 1 1 

6112 2299999999313121221 123121 1 12131223321 132313231323OU5026OIOIO2 

6113 OU0 1 020 1 020202 0523 1 U3U22U222 

6121 123333255555 15323 111111111111 1 1333233333333332 1 99999999 

6122 111999119132299999923299999992219999999932992999923229299292 

6123 11 1911 1 19912191 1 1 1993299299992219999999932299999923229999992 
612U 322999999232299999921333333330i»OOU501000U04000101030101020202 
6125 020202020399990899999902222U225U2 

6131 1233332551 1 1 15125255553333232233333313333133321333333 

6132 329299999222999999992299999999219999999932292992993229299299 

6133 32992929223299292992329999229221999999991 1 191 1911 13299999299 
613U 3299992299329929999932992999993333333333333313333333333333333 
6135 330U00300200000502030201010300030000000U03U1I2U2U224U1232UU2 
61U1 12233311*112225512199999999229999999932992929923292992992 
6lH2 119119191121999999991119119199219999999921999999993299299992 
6lU3 1199119911329929922232929992223331211991191112199999999 

em 3229299292322929929232292992921333223321 12331 1123220U00200302 

61U5 020202030203020030002020U023222UUU22UU22U2U22323 ' 

6151 232 1 22 1 1 1 2022 1 0000000000000002222 1 1 0 1 1 00 1 003023222 1 3 1 22070000 

6152 0300002223 12 122323333339 12 10120070020002323232U32U2333UUUU323 

6153 322U32313'4'4332233U3 2122 

6201 3U3U53UUl^32U55155U152UUUU525315U3UUUUUU2 

6202 122 1 22 1 1 1 1 1 222 1 222 1 2 122222 12112212221221 

6203 U9939931 IU399929993929999929U29929991992 

62 1 1 U25U223 1U2555 1 U 1222U5UUU3U2UUUUU23U 

6212 11221111212121111112212212122222122 

6213 I39922U3929193322139919939299999299 

6221 U5U212U1551U21UU333553'*UU2UUUU2UUUU 

6222 221 1 1 12122121 1221212212221 122212222 

6223 9921329U993913991919929992 199939991 

6231 U252522U1UU23U5UUU2U233UUU35U51^1U23 

6232 212121 121 121222222121 1 122212222121 1 

6233 9U9393U93192999999U921 1999199993922 
62U1 UUU1U53U35335UUU313UU1U2559U1WUUUU 
62U2 1221221 1221 1222221221 1 1 122921 1221 1 1 
62U3 1992992 I99129999939913'*2999931991 11 
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81 1112 22 0 0 0 0 0222222 

6001 131101017 3 22520222229159 09 01021 5 '<513531 60211 8 2 0 

6002 180270300390 125 125 120 115 150 150 H5 >iO 55 60 50 60120120 35 30 

6003 ^2 2 355191917101101 51101151201301121 09332233315 
600" 113122121 133 122ll55222iiK252K 

6101 1213222332222322221219991 19932922999991 1 1 19991191 111991 199 
61C2 1 1 1 1991 191219999999921999999992299999999329922229932999992922 
6103 33223331 13222121999999991 1 1 199 1 19922999999991 1 1 1991 199 
6lOi) 219999999922999999991 130li5'<5002000202020002009C10101010101032 
6105 21152223213211223 

61 1 1 1 1232222(?2222222221 1 1 1 1219999999922999999992299999999 

6112 2299999999 1 1 222 1 232232 11221223131 2332 1 223 1 223 1 2230J450 1 20 1 0 1 02 

61 13 0101010101010101212122221321 

6121 11 222321225325322222 1121151111 23332332332332 1 2299999999 

6122 1 1 1 1991 19132229999992299999999229999999932922999923292299992 

6123 1111191111 12191991 192299999999229999999922999999993292299992 
6121 2999999999299999999912322223301502001000101000000030102010101 
6125 0 1 0 1 0 1 0 1 0 1 99990 1 99999902221 32 1 122 

61311 22322255 1 3325535 1 355 1 23 1 3 1 322332233 1 3233233333 1 33333 

6132 229999999932929999922299999999219999999932299999993229999999 

6133 32299999993299999992229999999921999999991 1 199999993292999999 
6131 3292999992329299999232929999922323333122332313233331333331323 
61 35 33015022020000030 10 1 020 1 0 1 0 1 0 1 020 1 0000010221322122312212112 

6111 1 123221 1 1 1 1 1 1 1 151 1 1 1 1 1991 191 1 1 199919922999999992299999999 

6112 111919911911191991191119199199299999999931992299221111199199 

6113 1 1 1 1 19919939999999992999999999322121 1 1 1 1991 192199999999 

6111 2299999999322299999922999999991323122322313211122320150090101 
6115 0101010101 020 1 3030 1 0202030222 1 2223 1 1 323122123332 

6151 2311111 22222 1 2 1 00 1 1 002 1 00 12002222 1 122 1 1 1 1 22322333222222060020 

6152 020000 1 1 2 1 22 1 2 1 32323333322 1 01 9002O000003331113313331133223131 

6153 1133321333131233331 2222 

6201 3512112112331315531111133512315511112122 

6202 1221221221 22222222 1 2 1 22222 1 1 1 1 22222222 1 1 

6203 1991993993999999993939999931139999999922 

621 1 32131 1213113513223311131313131221 11 

6212 21222111212121121212212212221211212 

6213 9399921393919339391991991999292^4939 
622 11131 223215 1 32 1 112325 133311211133153 

6222 22 1 1 1 12122 12 1 1221 1 12 122222 122222222 

6223 99133292993923992219199999199999999 

623 1 5 1125 133 12333133312353335335211 1331 

6232 2121211211 22222222 1 22 1 222222 1221221 

6233 91939319119999999939919999991993991 

621 1 1322533 1 253 1 51333 1 1 322 1 152 1 3 1 352332 

6212 22222221222 12222 1 1 12 1 1 1 122 1212222 1 1 

6213 9999999399939999131911119929399991 1 
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8102001 2 






















8001 2 128 105 
8102002 2 


67 


JO 


A 
V 




ii 
** 


15 


0 


0 


It 

4 


1 176 8 '<52321111 


8001 2 123 
8105003 2 


67 


58 


0 


0 26 


1 


2 


1 


2 


1 


2187 8 '<3552'<121 


8001 5 68 51 
810300'< 2 


32 


20 


0 


0 28 


5 


12 


0 


0 


5 


12175 7 '155116631 


8001 2 226 226 
8105005 2 


107 


88 


0 


0 26 


H 


1 


1 


1 


2 


0180 7 H55323311 


8001 3 220 221 


115 


108 


0 


0 HH 


6 


10 


2 


0 


2 


0175 7 1*75521111 
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001 (22 » 18) - (H7 +59) IS EQUAL TO 

1 001 1 1 0 20 2 3^ 0 1 6 03 05 06 08 09 15 'J5 
15 2 3^^ 527 513 511 

22 2 3H 527 000 513 
25 2 3^^ 527 515 515 
1»0 2 3^^ 527 517 517 
5^ 0 20 527 000 523 
63 2 3^^ 527 517 517 
79 2 3^^ 527 517 517 
81 2 3^^ 527 515 515 

002 MATCHSTICKS ARE ARRANGED AS FOLLOWS. IF THE PATTERN IS 

2 001 3 0 0 31 12 0 1 6 09 15'16 
15 'J 12 527 513 511 

22 ^ 12 527 000 513 
25 a 12 527 515 515 
HO H 12 527 517 517 
5^^ 0 31 527 523 523 2 3^^ 
63 'J 12 527 517 517 
79 12 527 517 517 
81 H 12 527 515 515 

003 2/5 ♦ 3/8 IS EQUAL TO 

5 002 1 1 0 17 0 31 1 1 1 03 06 08 10 11 15 ^^3 ^^5 
15 0 31 527 523 521 
22 0 31 527 523 523 
25 0 31 527 523 523 
HO 0 31 527 527 527 
5H 0 17 527 523 523 1 01 
63 0 31 527 527 527 
79 0 31 527 527 527 
81 0 31 527 523 523 

00i» WHICH OF THE FOLLOWING IS A PAIR OF EQUIVALENT FRACTIONS? 

H 002 2 0 0 14 3 3 0 1 1 10 15 16 
15 0 OU 527 523 521 3-3 

22 3 03 527 000 413 /e "1/2 and 14/24" -> "1/2 and 14/15" 

25 3 03 527 515 515 

40 3 03 527 517 517 

54 0 14 527 000 523 

63 3 03 527 517 517 

79 3 03 527 517 517 

81 3 03 527 515 515 

005 0.40 » 6.38 IS EQUAL TO 

3 003 1 1 0 18 0 26 0 1 1 03 05 06 08 12 15 43 45 
15 2 10 527 513 511 0-26 

22 0 26 527 523 523 
25 0 26 527 523 523 
40 0 26 527 527 527 
54 0 18 527 000 523 
63 0 26 527 527 527 
79 0 26 527 527 527 
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81 0 26 527 523 523 
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lEA SECOND MATHEMATICS STUDY 


• • 


DATA DOCUMENTATION FILE 


• • 


POPULATION A 


• • 


CLASSROOM PROCESS (LONGITUDINAL) 


• • 



INTRODUCTION 



THIS IS A DATA DOCUMENTATION FILE FOR POPULATION A OF THE lEA 
SECOND INTERNATIONAL MATHEMATICS STUDY, SPECIFICALLY FOR THE 
EIGHT COUNTRIES THAT PARTICIPATED IN THE CLASSROOM PRXESS 
(LONGITUDINAL) VERSIONS OF THE STUDY. IT IS INTENDED TO BE READ 
BY PROGRAMS THAT WILL PRINT CODEBOOKS AND PROVIDE ENTRY INTO 
STATISTICAL ANALYSIS SYSTEMS. IT PROVIDES UNIFIED INFORMATION 
ABOUT THE STORAGE AND CODING OF ALL THE COUNTRIES, COVERING' THE 
INTERNATIONAL STANDARD SYSTEMS AS WELL AS PARTICULAR NOTES ABOUT 
THE NATIONAL VARIATIONS, SAMPLING DESIGNS, ETC. THE RESPONSE 
DATA DESCRIBED IN THIS DOCUMENTATION ARE STORED IN SEPARATE DATA 
FILES, AS DESCRIBED IN SECTION 2 BELOW. 



TABLE OF CONTENTS 

SECTION 1. BASIC PARAMETERS AND SIZES. 

SECTION 2. DEFINITION OF THE RESPONSE DATA LAYOUT. 

SECTION 3. COGNITIVE ITEM TABLE. 

SECTION 1|. QUESTIONNAIRE ITEM TABLE. 

SECTION 5. SAMPLING NOTES AND STRATUM DEFINITIONS 

SECTION 6. DETAILED CODING AND TEXTUAL EXPLANATIONS. 



EACH SECTION BEGINS WITH A LINE FILLED WITH ASTERISKS. THIS IS 
FOLLOWED BY AN INTRODUCTORY TEXT, WHICH ENDS WITH A LINE FILLED 
WITH MINUS SIGNS (-). THEN, EXCEPT FOR SECTION 2, THERE FOLLOWS 
A SPECIALLY FORMATTED TABLE OR CODED LISTING THAT IS INTENDED FOR 
VISUAL INSPECTION OR PROGRAMMED INTERPRETATION. THE FINAL LINE OF 
A SECTION IS FILLED WITH SLASHES (/), SUCH AS NOW TERMINATE THIS 
INTRODUCTION. 
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.. SECTION 1 

BASIC PARAMETERS AND SIZES 



THE TABLE PRESENTED IN THIS SECTION DEFINES, THE BASIC 
PARAMETERS AND SIZES OF THE DATASET FOR EACH COUNTRY BEING 
DOCUMENTED IN THIS FILE. THESE INCLUDE THE NUMBERS OF ITEMS 
(INTER>JATIONAL AND NATIONAL) IN EACH COGNITIVE TEST FORM, THE 
SAMPLE OF APPLICATION AND QUESTIONS ASKED WITH EACH FORM, FOR 
TEACHER OTL AS WELL AS STUDENT PRETEST AND POSHEST. THERE IS 
ALSO INDICATION OF THE UTILIZATION OF EACH OF THE POSSIBLE 
QUESTIONNAIRES AND DATA SOURCES, TOGETHER WITH THE NUMBER OF 
INTERNATIONAL AND NATIONAL VARIABLES INCLUDED IN THEM. FOR EACH 
COUNTRY BEING DOCUMENTED, THERE IS ONE LINE WITH THE CODE NUMBER 
AND NAME OF THE COUNTRY, FOLLOWED BY ONE LINE FOR EACH COGNITIVE 
TEST FORM, FOLLOWED BY ONE LINE FOR EACH QUESTIONNAIRE OR DATA 
SOURCE. LINES MAY BE OMITTED IF THE CORRESPONDING FORM, 
QUESTIONNAIRE, OR SOURCE WAS NOT USED FOR A COUNTRY. ^^HERE MAY 
BE COMMENTS AT THE END OF A LINE. THE LAYOUT IS AS FOLLOWS... 



.1231*5678901231*5678901231*5678901231*5678901231*5678901231*567890123. 

.CC' ' NAME OF THE COUNTRY 

. 0 U III NNN SQSQSQ CORE TEST 

1 U III NNN SQSQSQ TEST FORM A 

. 2 U III NNN SQSQSQ TEST FORM B 

. 3 U III NNN SQSQSQ TEST FORM C 

1* U III NNN SQSQSQ TEST FORM D 

. 5 U III NNN SQSQSQ SPECIAL JAPANESE PRETEST 

P U III NNN S POPULATION DATA 

Q U III NNN S STRATUM DATA 

. S U III NNN S SCHOOL QUESTIONNAIRE 

K U III NNN S BEGINNING-OF-YEAR CLASSROOM OATA 

. L U III NNN S END-OF-YEAR CLASSROOM DATA 

. T U III NNN S TEACHER QUESTIONNAIRE 

F U III NNN S TOPIC-SPECIFIC FRACTIONS 

R U III NNfJ S TOPIC-SPECIFIC RATIO PROPORTION PERCENT . 

. M U III NNN S TOPIC-SPECIFIC MEASUREMENT 

. G U III NNN S TOPIC-SPECIFIC GEOMETRY 

A U III NNN S TOPIC-SPECIFIC ALGEBRA 

. C U III NNN S CLASSROOM PROCESS GENERAL 

. X U III NNN S BEGINNING-OF-YEAR STUDENT QUESTIONNAIRE 
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Y U III NNN S 



END-OF-YEAR STUDENT QUESTIONNAIRE 



ERIC 
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15 BELGIUH FLEMISH 



0 


2 


OHO 


272323 


CORE TEST 


1 


2 


035 


271111 


TEST FORM A (NB. Rotated forms used 


2 


2 


035 


271111 


TEST FORK B at pretest and posttest, 


3 


2 


035 


271111 


TEST FORM C with complete rotation) 


H 


2 


035 


271111 


TEST FORM D 


s 


1 


017 


2 


SCHOOL QUESTIONNAIRE 


T 


1 


051 


2 


TEACHER QUESTIONNAIRE 


Y 


1 


08^ 


2 


END OF YEAR STUDENT QUESTIONNAIRE 


P 


2 


001 


2 


POPULATION DATA 


Q 


2 


003 


2 


STRATUM DATA 


S 


1 


017 


2 


SCHOOL QUESTIONNAIRE 


K 


2 


001 


2 


BEGINNING-OF-YEAR CLASSROOM DATA 


L 


2 


001 


2 


END-OF-YEAR CLASSROOM DATA 


T 


1 


051 


2 


TEACHER QUESTIONNAIRE 


G 


2 


182 


2 


TOPIC-SPECIFIC GEOMETRY 


A 


2 


153 


2 


TOPIC-SPECIFIC ALGEBRA 


C 


2 


OIH 


2 


CLASSROOM PROCESS GENERAL 


X 


2 


007 


2 


BEGINNING-OF-YEAR STUDENT QUESTIONNAIRE 


Y 


1 


084 


2 


END OF YEAR STUDENT QUESTIONNAIRE 
CANADA BC 


0 


2 


OHO 


272323 


CORE TEST 


1 


2 


035 


27 13 


TEST FORM A (NB. No rotated forms 


2 


2 


035 


27 13 


TEST FORM B on the pretest) 


3 


2 


035 


27 13 


TEST FORM C 


K 


2 


035 


27 13 


TEST FORM D 


S 


1 


017 


2 


SCHOOL QUESTIONNAIRE 


T 


1 


051 


2 


TEACHER QUESTIONNAIRE 


Y 


1 


08i| 


2 


END OF YEAR STUDENT QUESTIONNAIRE 


P 


2 


001 


2 


POPULATION DATA 


Q 


2 


003 


2 


STRATUM DATA 


S 


1 


017 


2 


SCHOOL QUESTIONNAIRE 


K 


2 


001 


2 


BEGINNING-OF-YEAR CLASSROOM DATA 


L 


2 


001 


2 


END-OF-YEAR CLASSROOM DATA 


T 


1 


051 


2 


TEACHER QUESTIONNAIRE 


F 


2 


135 


2 


TOPIC-SPECIFIC FRACTIONS 


R 


2 


103 


2 


TOPIC-SPECIFIC RATIO PROPORTION PERCENT 


M 


2 


150 


2 


TOPIC-SPECIFIC MEASUREMENT 


G 


2 


182 


2 


TOPIC-SPECIFIC GEOMETRY 


A 


2 


153 


2 


TOPIC-SPECIFIC ALGEBRA 


C 


2 


o^n 


2 


CLASSROOM PROCESS GENERAL 


X 


2 


007 


2 


BEGINNING-OF-YEAR STUDENT QUESTIONNAIRE 


Y 


1 


06k 


2 


END OF YEAR STUDENT QUESTIONNAIRE 
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25 CANADA ONT 

0 2 OHO 272323 CORE TEST 

1 2 035 271515 TEST FORM m (NB. Rotated forms at pre 

2 2 035 271515 TEST FORM B and post, with complete 

3 2 035 271515 TEST FORM C rotation) 
^» 2 035 271515 TEST FORM D 

S 1 017 2 SCHOOL QUESTIONNAIRE 

7 1 051 2 """^ACHER QUESTIONNAIRE 

y ^ 08U 2 END OF YEAR STUDENT QUESTIONNAIRE 

S 1 017 2 SCHOOL QUESTIONNAIRE 

T 1 051 2 TEACHER QUESTIONNAIRE 

Y 1 08H 2 END OF YEAR STUDENT QUESTIONNAIRE 

P 2 001 2 POPULATION DATA 

Q 2 003 2 STRATUM DATA 

S 1 017 2 SCHOOL QUESTIONNAIRE 

K 2 001 2 BEGINNING-OF-YEAR CLASSROOM DATA 

L 2 001 2 END-OF-YEAR CLASSROOM DATA 

T 1 051 2 TEACHER QUESTIONNAIRE 

P 2 135 2 TOPIC-SPECIFIC FRACTIONS 

f 2 103 2 TOPIC-SPECIFIC RATIO PROPORTION PERCENT 

M 2 150 2 TOPIC-SPECIFIC MEASUREMENT 

G 2 182 2 TOPIC-SPECIFIC GEOMETRY 

A 2 153 2 TOPIC-SPECIFIC ALGEBRA 

C 2 Om 2 CLASSROOM PROCESS GENERAL 

^ 2 007 2 BEGINNING-OF-YEAR STUDENT QUESTIONNAIRE 

, ^ 1 08H 2 END OF YEAR STUDENT QUESTIONNAIRE 

'♦O FRANCE 

0 2 Oi»0 272727 CORE TEST 

1 2 035 271717 TEST FORM A (NB. Same rotated form 

2 2 035 271717 TEST FORM B given at posttest as 

3 2 035 271717 TEST FORM C at pretest) 
^ 2 035 271717 TEST FORM D 

P 2 001 2 POPULATION DATA 

Q 2 003 2 STRATUM DATA 

S 1 017 2 SCHOOL QUESTIONNAIRE 

K 2 001 2 BEGINNING-OF-YEAR CLASSROOM DATA 

L 2 001 2 END-OF-YEAR CLASSROOM DATA 

T 1 051 2 TEACHER QUESTIONNAIRE 

f 2 135 2 TOPIC-SPECIFIC FRACTIONS 

f 2 103 2 TOPIC-SPECIFIC RATIO PROPORTION PERCENT 

M 2 150 2 TOPIC-SPECIFIC MEASUREMENT 

G 2 182 2 TOPIC-SPECIFIC GEOMETRY 

A 2 153 2 TOPIC-SPECIFIC ALGEBRA 

C 2 014 2 CLASSROOM PROCESS GENERAL 

^ 2 007 2 BEGINNING-OF-YEAR STUDENT QUESTIONNAIRE 

^ 1 08H 2 END OF YEAR STUDENT QUESTIONNAIRE 



ERIC 
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54 JAPAN 



0 


1 


OHO 


27 


27 


CORE TEST (NB. Crosssectional forms 


1 


1 


034 


27 


17 


TEST FORM A used at posttest, 


2 


1 


034 


27 


17 


TEST FORM B special 60-item pretest 


3 


1 


034 


27 


17 


TEST FORM C used at pretest) 


4 


1 


034 


27 


17 


TEST FORM D 


5 


9 


060 


21 




SPECIAL JAPANESE PRETEST 


S 


1 


017 


2 




SCHOOL QUESTIONNAIRE 


T 


1 


051 


2 




TEACHER QUESTIONNAIRE 


y 


1 


08^ 


2 




END OF yEAR STUDENT QUESTIONNAIRE 


p 


2 


001 


2 




POPULATION DATA 


Q 


2 


003 


2 




STRATUM DATA 


s 


1 


017 


2 




SCHOOL QUESTIONNAIRE 


K 


2 


001 


2 




BEGINNING-OF-y£AR CLASSROOM DATA 


L 


2 


001 


2 




END-OF-yEAR CLASSROOM DATA 


T 


1 


051 


2 




TEACHER QUESTIONNAIRE 


G 


2 


182 


2 




TOPIC-SPECIFIC GEOMETRy 


A 


2 


153 


2 




TOPIC-SPECIFIC ALGEBRA 


C 


2 


014 


2 




CLASSROOM PROCESS GENERAL 


X 


2 


007 


2 




BEGINNING-OF-yEAR STUDENT QUESTIONNAIRE 


y 


1 


084 


2 




END OF yEAR STUDENT QUESTIONNAIRE 



81 UNITED STATES 



0 


2 


040 


272323 


CORE TEST 


1 


2 


035 


271515 


TEST FORM A (NB. Rotated forms given at 


2 


2 


035 


271515 


TEST FORM B pretest and posttest, 


3 


2 


035 


271515 


TEST FORM C with complete rotation) 


K 


2 


035 


271515 


TEST FORM D 


S 


1 


017 


2 


SCHOOL QUESTIONNAIRE 


T 


1 


051 


2 


TEACHER QUESTIONNAIRE 


y 


1 


084 


2 


END OF yEAR STUDENT QUESTIONNAIRE 


p 


2 


001 


2 


POPULATION DATA 


Q 


2 


003 


2 


STRATUM DATA 


s 


1 


017 


2 


SCHOOL QUESTIONNAIRE 


K 


2 


001 


2 


BEGINNING-OF-yEAR CLASSROOM DATA 


L 


2 


001 


2 


END-OF-yEAR CLASSROOM DATA 


T 


1 


051 


2 


TEACHER QUESTIONNAIRE 


F 


2 


135 


2 


TOPIC-SPECIFIC FRACTIONS 


R 


2 


103 


2 


TOPIC-SPECIFIC RATIO PROPORTION PERCENT 


M 


2 


150 


2 


TOPIC-SPECIFIC MEASUREMENT 


G 


2 


182 


2 


TOPIC-SPECIFIC GEOMETRy 


A 


2 


153 


2 


TOPIC-SPECIFIC ALGEBRA 


C 


2 


014 


2 


CLASSROOM PROCESS GENERAL 


X 


2 


007 


2 


BEGINNING-OF-yEAR STUDENT QUESTIONNAIRE 


y 


1 


084 


2 


END OF yEAR STUDENT QUESTIONNAIRE 



///////////////////////////////////////////////////////////////// 
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SECTION 2 

DEFINITION OF THE RESPONSE DATA LAYOUT 



THE RESPONSE DATA FILES ARE STORED SEPARATELY FROM THIS 
DOCUMENTATION FILE. THERE ARE THREE RESPONSE DATA FILES FOR 
EACH POPULATION OF EACH COUNTRY. ONE FILE CONTAINS ALL THE 
RESPONSE FROM THE STUDENT DATA COLLECTION LEVEL, ONE CONTAINS 
ALL THE DATA FROM THE TEACHER, AND ONE CONTAINS ALL THE DATA FROM 
THE SCHOOL. 



PHYSICAL RECORD LAYOUT 
- 80-CHARACTER RECORDS 



THESE MAY BE BLOCKED ACCORDING TO THE PARTICULAR SPECIFICATIONS OF 
THE TAPE OR DISK. ALSO, UNUSED TRAILING COLUMNS MAY BE LEFT 
BLANK OR TRIMMED OFF. 



RECORDS PER CASE 

- THERE ARE A FIXED NUMBER OF RECORDS PER CASE, THAT IS ! 

PER SCHOOL, TEACHER OR STUDENT. THE NUMBER OF RECORDS. 

VARIES FROM COUNTRY TO COUNTRY, DEPENDING ON WHICH 

INSTRUMENTS WERE EMPLOYED (SEE SECTION 1) 



AT THE END OF THIS DOCUMENTATION SECTION THERE IS A 
TABLE SHOWING THE NUMBER OF RECORDS FOR EACH KIND OF 
FOR EACH COUNTRY. 



ERIC 



-68- 

73 



Appendix IV, page 15 



IDENTIFICATION RECORD 

• 

- A BLXK OF RECORDS, CORRESPONDING TO A SCHOOL, A 
TEACHER, OR A STUDENT, BEGINS WITH A SPECIAL 
IDENTIFICATION RECORD, WHICH GIVES THE ID CODES FOR 
THE POSITION OF THE CASE IN THE DATA HIERARCHY AND 
ALSO GIVES SPECIAL DATA AVAILABILITY CODES FOR EACH 

OF THE POSSIBLE DATA COLLECTION INSTRUMENTS THAT COULD . 
APPLY TO THE CASE, TOGETHER WITH SAMPLING WEIGHTS, ETC.. 

- THE LAYOUT OF THE IDENTIFICATION RECORD DEPENDS ON THE . 
DATA LEVEL 



• • • 



15 Belgium Flemish 

2 Records for each school 
1 Identification record 
1 Data record, school questionnaire (800) 
33 Records for each teacher/classroom 
Identification record 

Data records, teacher background questionnaire (600) 
Data records, geometry questionnaire (613) 
Data records, algebra questionnaire (6l4) 
Data records, general classroom process questiornaire (615) 
Data records, OTL, core test (620) 

rotated form A (621) 
rotated form B 
rotated form C 
rotated form D 



1 
ii 
5 
5 
3 
3 
3 
3 
3 
3 

1 
1 
1 

1 
3 

1 



OTL, 
OTL, 
OTL, 
OTL, 



(622) 
(623) 
(62il) 



Data records, 
Data records. 
Data recoi ds. 
Data records, 
Records for each student 
Identification record 

Data record, pretest background questionnaire (500) 

Data record, pretest core (510) 

Data record, pretest rotated form (511-51^) 

Data records, posttest background questionnaire (520) 

Data record, posttest core (520) 

Data record, posttest rotated form (521-52^) 
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22 British Columbia " 
2 Records for each school 
1 Identification record 
1 Data record, school questionnaire (800) 
^6 Records for each teacher/classroom 
1 Identification record 

J Data reccrcls, teacher background questionnaire (600) 
5 Data records, fractions questionnaire (610) 
3 Data records, ratio/proportion/percent questionnaire (611) 
5 Data records, measurement questionnaire (612) 
5 Data records, geometry questionnaire (613) 
5 Data records, algebra questionnaire (61^1) 
3 Data records, general classroom process questionnaire (615) 
3 Data. records, OTL, core test (620) 
3 Data records, OTL, rotated form A (621) 
3 Data records, OTL, rotated form B (622) 
3 Data records, OTL, rotated form C (623) 
3 Data records, OTL, rotated form D (62l|) 
10 Records for each student 
1 Identification record 

1 Data record, pretest background questionnaire (500) 

1 Data record, pretest core (510) 

3 Data records, posttest background questionnaire (520) 

2 Data record, posttest core (520) 

2 Data record, posttest rotated form (521-52i<) 
25 Ontario 

2 Records for each school 
1 Identification record 
1 Data record, school questionnaire (800) 

Records for each teacher/classroom 
1 Identification record 

^ Data records, teacher background questionnaire (600) 
5 Data records, fractions questionnaire (610) 

3 Data records, ratio/proportion/percent questionnaire (611) 
5 Data records, measurement questionnaire (612) 
5 Data records, geometry questionnaire (613) 
5 Data records, algebra questionnaire (6ll*) 
3 Data records, general classroom process questionnaire (615) 
3 Data records, OTL, core test (620) 
3 Data records, OTL, rotated form A (621) 
3 Data records, OTL, rotated form B (622) 
3 Data records, OTL, rotated form C (623) 
3 Data records, OTL, rotated form D (62il) 

Records for each student 
1 Identification record 

1 Data record, pretest background questionnaire (500) 

2 Data record, pretest core (510) 

2 Data record, pretest rotated form (511-51i|) 

3 Data records, posttest background questionnaire (520) 
2 Data record, posttest core (520) 
2 Data record, posttest rotated form (521-52i|) 



i(6 
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^0 Franca 

2 Records for each sctiool 

1 Identification record 

1 Data record, school questionnaire (800) 

U6 Records /or each teacher/classroom 

1 Identification record 

4 Data records, teacher background questionnaire (600) 

5 Data records, fractions questionnaire (610) 

3 Data records, ratio/proportion/percent questionnaire (611) 

5 Data records, measurement questionnaire (612) 

5 Data records, geometry questionnaire (613) 

5 Data records, algebra questionnaire (6li|) 

3 Data records, general classroom process questionnaire (6 15) 

3 Data records, OTL, core test (620) 

3 Data records, OTL, rotated form A (621) 

3 Data records, OTL, rotated form B (622) 

3 Data records, OTL, rotated form C (623) 

3 Data records, OTL, rotated form D (62^*) 

17 Records for each student 

1 Identification record 

1 Data record, pretest background questionnaire (500) 

3 Data record, pretest core (510) 

3 Data record, pretest rotated form (511-51^) 

3 Data records, posttest background questionnaire (520) 

3 Data record, posttest core (520) 

3 Data record, posttest rotated form (521-52^*) 



81 U.S.A. 

2 Records for each school 

1 Identification record 

1 Data record, school que tionnaire (800) 

^6 Records for each teacher/classroom 

1 Identification record 

4 Data records, teacher background questionnaire (600) 

5 Data records, fractions questionnaire (610) 

3 Data records, ratio/proportion/percent questionnaire (611) 

5 Data records, measurement questionnaire (612) 

5 Data records, geometry questionnaire (613) 

5 Data records, algebra questionnaire (6li|) 

3 Data records, general classroom process questionnaire (6l5) 

3 Data records, OTL, core test (620) 

3 Data records, OTL, rotated form A (621) 

3 Data records, OTL, rotated form B (622) 

3 Data records, OTL, rotated form C (623) 

3 Data records, OTL, rotated form D (62i|) 

13 Records for each student 

1 Identification record 

1 Data record, pretest background questionnaire (500) 

2 Data record, pretest core (51<^) 

2 Data record, pretest rotated form (511-514) 

3 Data records, posttest background questionnaire (520) 
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2 Data record, posttest core (520) 

2 Data record, posttest rotated form (521-52^4) 

lllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllll 



-72- 77 



$ type document: a. 3 



Appendix IV, page 



SECTION 3 

COGNITIVE ITEM TABLE 



IN THIS TABLE, THERE ARE FOR EACH OF THE 199 INTERNATIONAL 
COGNITIVE ITEMS TWO LINES OF INTERNATIONAL INFORMATION PLUS ONE 
LINE OF NATIONAL INFORMATION FOR EACH COUNTRY DESCRIBED IN THIS 
FILE. THE INTERNATIONAL INFORMATION INCLUDES THE ITEM NUMBER AND 
ABBREVIATED TEXT, THE KEY, THE CONTENT CODES, THE STANDARD FORMS 
AND ITEM POSITIONS, AND THE SUBTEST MAPPINGS. THE NATIONAL 
INFORMATION INCLUDES THE NATIONAL FORM AND ITEM POSITION AND 
APPLICATION KEYS FOR TEACHER OTL, STUDENT PRETEST, AND STUDENT 
POSTTEST USE OF THE ITEM. INFORMATION ABOUT NATIONAL OPTION ITEMS 
IS ALSO INCLUDED, AS DESCRIBED LATER. 



INTERNATIONAL LINE ONE 



1-3 ITEM REFERENCE NUMBER FROM ITEM BANK 

5-80 ABBREVIATED TEXT OF THE INTERNATIONAL FORM OF THE ITEM 



78 
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INTERNATIONAL LINE TWO 



5 CORRECT RESPONSE ALTERNATIVE 

1 A 

2 B 

3 C 
H D 
5 E 

7-9 POSITION IN INTERNATIONAL CONTENT GRID 

000 ARITHMETIC 

001 WHOLE NUMBERS 

002 COMMON FRACTIONS 

003 DECIMAL FRACTIONS 

004 RATIO, PROPORTION, PERCENT 

005 NUMBER THEORY 

006 POWERS 

100 ALGEBRA 

101 INTEGERS 

102 RATIONALS 

103 INTEGER EXPONENTS 
10i< FORMULAS 

105 POLYNOMIALS EXPRESSIONS 

106 EQUATIONS AND INEQUATIONS 

107 RELATIONS 

200 GEOMETRY 

201 CLASSIFICATION 

202 PROPERTIES 

203 CONGRUENCE 
20H SIMILARITY 

205 GEOMETRIC CONSTRUCTIONS 

206 PYTHAGOREAN 

207 COORDINATES 

208 DEDUCTIONS 

209 TRANSFORMATION (INFORMAL) 
212 SPATIAL VISUALIZATION 
215 TRANSFORMATIONAL GEOMETRY 
300 PROBABILITY AND STATISTICS 

302 ORGANIZATION 

303 REPRESENTATION 

304 MEAN, MEDIAN, MODE 
306 PROBABILITY 

HOO MEASUREMENT 

101 UNITS 

H02 ESTIMATION 

103 APPROXIMATION 

m DETERMINING MEASURES 
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11 BEHAVIOURAL LEVEL 

1 COMPUTATION 

2 COMPREHENSION 

3 APPLICATION 

4 ANALYSIS 

13 ANCHOR ITEM STATUS 

0 NOT AN ANCHOR 

1 ANCHOR ITEM 

2 MODIFIED ANCHOR ITEM 

1C FORM PLACEMENT FOR THE CROSSSECTIONAL STUDY 

17-18 POSITION WITHIN FORM FOR THE CROSSSECTONAL STUDY 

20 FORM PLACEMENT FOR THE LONdlTUDINAL STUDY 
22-23 POSITION WITHIN FORM FOR THE LONGITUDINAL STUDY 

NOTE... THE PLACEMENT AND POSITION NUMBERS ARE ZERO 
FOR ITEMS NOT INCLUDED IN A GIVEN STUDY. THE 
PLACEMENT AND POSITION NUMBERS FOR THE LONGITUDINAL 
STUDY ARE THOSE OF THE SUGGESTED STANDARD. 

25 LONGITUDINAL CORE TYPE 

0 NOT LONGITUDINAL INTERNATONAL CORE 

1 LONGITUDINAL INTERNATIONAL CORE 

27 STRATUM FOR CROSSSECTIONAL FORM CONSTRUCTION 

1 ARITHMETIC 

2 ALGEBRA 

3 GEOMETRY 

1 PROBABILITY AND STATISTICS 

5 MEASUREMENT 

29 STRATUM FOR LONGITUDINAL FORM CONSTRUCTION 

1 FRACTIONS 

2 RATIO PROPORTION PERCENT 

3 ALGEBRA 
1 GEOMETRY 

5 MEASUREMENT 

6 INTEGERS (NOT IN INTERNATIONAL CORE) 

7 PROBABILITY AND STATISTICS (NOT IN 
INTERNATIONAL CORE) 

31-32 SUBTEST CODE 1 
3^-35 SUBTEST CODE 2 

79-80 SUBTEST CODE 17 
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THESE ARE THE SUBTESTS DEFINED IN MEMORANDUM A/369, 
WITH CORRECTIONS. THE NUMBER OF SUBTEST CODES PER 
ITEM VARIES. THE FOLLOWING SUBTEST CODES ARE USED. 

01 ESTIMATION AND APPROXIMATION 

02 NEW MATHS IN 1ST STUDY 

03 BASIC SKILLS 

OU ALGEBRA (COMPUTATION) 

05 CALCULATOR USE 

06 ARITHMETIC (COMPUTATION) 

07 PROPORTIONATE THINKING 

08 ANCHOR ITEMS 

09 WHOLE NUMBERS 

10 COMMON FRACTIONS 

11 COMMON FRACTIONS (COMPUTATION) 

12 DECIMAL FRACTIONS 

13 RATIO AND PROPORTION 
li* PERCENT 

15 ARITHMETIC 

16 ARITHMETIC (OTHER THAN COMPUTATION) 

17 INTEGERS 

18 FORMULAS AND ALGEBRAIC EXPRESSIONS 

19 EQUATIONS AND INEQUATIONS 

20 ALGEBRA 

21 ALGEBRA (OTHER THAN COMPUTATION) 

22 CLASSIFICATION OF PLANE FIGURES 

23 PROPERTIES OF PLANE FIGURES 
2M CONGRUENCE OF PLANE FIGURES 

25 SIMILARITY OF PLANE FIGURES 

26 PLANE FIGURES 

27 COORDINATES 

28 INFORMAL TRANSFORMATIONS IN GEOMETRY 

29 GEOMETRY 

30 GEOMETRY (COMPUTATIO!i) 

31 GEOMETRY (OTHER THAN COMPUTATION) 

32 REPRESENTATION OF DATA 

33 (NOT USED) 

3^ PROBABILITY AND STATISTICS 

35 PROBABILITY AND STATISTICS (OTHER THAN 
COMPUTATION) 

36 STANDARD UNITS OF MEASURE 

37 DETERMINATION OF MEASURES 

38 MEASUREMENT 

39 MEASUREMENT (COMPUTATION) 

10 MEASUREMENT (OTHER THAN COMPUTATION) 

'♦I PROBABILITY AND STATISTICS (COMPUTATION) 

^2 MODIFIED ANCHOR ITEMS 

13 NON-VERBAL 

11 VERBAL 

15 ANCHOR (NON-VERBAL) 

16 ANCHOR (VERBAL) 

17 DIAGRAMMATIC ITEMS (PAIRED WITH 
NON-DIAGRAMMATIC) 
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NON-DIAGRAMMATIC ITEMS (PAIRED WITH 
DIAGRAMMATIC) 
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NATIONAL LINE (ONE FER COUNTRY) 



2-3 COUNTRY CODE 

5 FORM PLACEMENT FOR THE NATIONAL STUDY 

7-8 POSITION WITHIN FORM FOR THE NATIONAL STUDY 

NOTE. THE PLACEMENT AND POSITION NUMBERS, AND ALL 
APPLICATION KEYS WHICH FOLLOW, ARE ZERO FOR ITEMS 
NOT INCLUDED IN THE NAT. JNAL STUDY. THE TOTAL NUMBER 
OF INTERNATIONAL ITEMS PER FORM IS GIVEN IN SECTION 1 
ABOVE. IN ADDITION, THERE MAY BE NATIONAL OPTION 
ITEMS AS DESCRIBED LATER. 

10-12 APPLICATION KEY FOR USE OF THE ITEM AS A TEACHER OTL ITEM 
l^l-ie APPLICATION KEY FOR USE OF THE ITEM AS A STUDENT PRETEST 
18-20 APPLICATION KEY FOR .ISE OF THE ITEM AS A STUDENT POSTTEST 

hJTE. THESE ARE 3-DIGIT CODES IN THE FORM (ABC). 

FOR EACH APPLICATION KEY, THE FIRST DIGIT (A) INDICATES 

THE QUALITY OF THE ITF" IMPLEMENTATION. 

0 NOT USEP (IMPLIES ZERO POSITION NUMBER ABOVE) 

1 USED BUT SPOILED 

2 NON-5' ANDARD ALTERNATIVES AND TEXT 

3 NON-STANDARD ALTERNATIVES 
H NON-STANDARD TEXT 

5 USED IN STANDARD FORM 
THE SrCOND AND TH^RD DIGITS (EC) WILL GENERALLY BE 
IN AGREEMENT WITH THE INFORMATION PROVIDED FOR THE FORM 
IN SECTION 1 ABOVE, BUT THERE MAY BE ERRORS OF PRINTING, 
CODING, ETC., TH;.T CAUSE AN ITEM'S USAGE TO DIF^^ER FROM 
THE FORM AS A WHOLE, PERHAPS JUST FOR ONE KIND OF APPLICATION. 
THE SECOND DIGIT (B) INDICATES THE SAMPLE TO WHOM THE ITEM 
WAS APPLIED. 

0 NO ONE 

1 A SAMPLE OF THE ELIGIBLE RESPONDENTS 

2 ALL RESPONDENTS 
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THE THIRD DIGIT (C) INDICftfES WHICH QUESTIONS WERE ASKED 
WITH THE QUESTION. FOR THE TEACHER OTL APPLICATION KEY, 
C NOT USED 

1 ESTIMATION 

2 TAUGHT OR REVIEWED 

3 U2 

k IF NOT WHY 
5 

6 2*li 

7 U2*>i 

FOR THE STUDENT PRETEST OR POSTTEST APPLICATION KEY, 

0 NOT USED 

1 TEST RESPONSE 

2 TAUGHT THIS YEAR 

3 U2 

M CALCULATOR 

5 UH 

6 2>i< 

7 U2*>i 

22 (FOR JAPAN ONLY) The part of the item on the special 
pretest. This is blank if the item is not in the 
pretest, or 1 or 2 for part one or two of the pretest. 
The first part haa 20 items, and the second had HO. 

2H-25 (FOR JAPAN ONLY) The item number within the part of the 
special pretest, or blank if the item is not in the 
pretest. 

27-80 COMMENTS CONCERNING PROBLEMS WITH QUALITY OR RESTRICTION 
OF SAMPLING APPLICATIONS OR QUESTIONS ASKED. 
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001 (22 » 18) - * 59) IS EQUAL TO 

1 001 1 1 0 20 2 S^i 0 1 6 03 05 06 08 09 15 
15 2 3U 527 513 511 

22 2 3'i 527 000 513 
25 2 3H 527 f15 515 
40 2 3'i 527 517 517 
5^ 0 20 527 000 523 
63 2 3H 527 517 517 
79 2 3'i 527 517 517 
81 2 3H 527 515 515 

002 MATCHSTICKS ARE ARRANGED AS FOLLOWS. IF THE PATTERN IS 

2 001 3 0 0 31 12 0 1 6 09 15 16 
15 a 12 527 513 511 

22 i» 12 527 000 513 
25 12 527 515 515 
10 H 12 527 517 517 
5'i 0 31 527 523 523 2 3H 
63 ^ 12 527 517 517 
79 12 527 517 517 
81 H 12 527 515 515 

003 2/5 * 3/8 IS EQUAL TO 

5 002 1 1 0 17 0 31 1 1 1 03 06 08 10 11 15 43 45 
15 0 31 527 523 521 
22 0 31 527 523 523 
25 0 31 527 523 523 
40 0 31 527 527 527 
54 0 17 527 523 523 1 01 
63 0 31 527 527 527 
79 0 31 527 527 527 
81 0 31 527 523 523 

004 WHICH OF THE FOLLOWING IS A PAIR OF EQUIVALENT FRACTIONS? 
4 002 2 0 0 14 3 3 0 1 1 10 15 16 

15 0 04 527 523 521 3-3 

22 3 03 527 000 413 /e "1/2 and 14/24" -> "1/2 and 14/15" 

25 3 03 527 515 515 

40 : 03 527 517 517 

54 0 14 527 000 523 

63 3 03 527 517 517 

79 3 03 527 517 517 

81 3 03 527 515 515 

005 0.40 * 6.38 IS EQUAL TO 

3 003 1 1 0 18 0 26 0 1 1 03 05 06 08 12 15 43 45 
15 2 10 527 513 511 0-26 

22 0 26 527 523 523 
25 0 26 527 523 523 
40 0 26 527 527 527 
5^ 0 18 527 000 523 
63 0 26 527 527 527 
79 0 26 527 527 527 
81 0 26 527 523 523 
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198 WHICH OF THE FOLLOWING PATORNS CAN BE FOLDED ALONG THE 
3 212 H 0 0 0 3 0 3 i| 29 31 

15 3 527 513 511 
22 3 04 527 000 513 
25 3 OH 527 515 515 
^0 3 OH 527 517 517 
5ii 0 00 000 000 000 
63 3 OH 527 517 517 
79 3 OH 527 517 517 
81 3 OH 527 515 515 

199 THE AREA OF THE SHADED CIRCLE IS WHAT PART OF THE AREA OF THE 
3 HOH 3 0 0 OH 9 0 5 5 37 38 HO 

15 H 09 527 513 511 
22 H 09 527 000 H13 
25 H 09 527 515 515 
HO H 09 527 517 517 
5H 0 00 000 000 000 
63 H 09 527 517 517 
79 H 09 527 517 517 
81 H 09 527 515 515 

///////////////////////////////////////////////////////////////// 
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SECTION 1| 

QUESTIONNAIRE ITEM TABLE 



THIS TABLE DEFINES THE DATA LEVEL, VARIABLE NAME, LONGITUDINAL 
INSTRUMENT LOCATION, DATA RECORD AND POSITION AND COLUMN WIDTH, 
SCALE IDENTIFICATION (FOR ATTITUDES), CROSSREFERENCE TO THE 
CROSSSECTIONAL INSTRUMENTATION, AND VARIABLE TITLE FOR EACH 
RESPONSE ITEM FROM ALL THE SURVEY QUESTIONNAIRES, EXCEPTING ONLY 
THE COGNITIVE INSTRUMENTS. THE TABLE CONTAINS INFORMATION 
CONCERNING ANY EXCEPTIONS IN THE APPLICATION OF AN ITEM IN A 
PARTICULAR COUNTRY. IN ADDITION TO THE INTERNATIONALLY DEFINED 
VARIABLES, THE TABLE INCLUDES INFORMATION ABOUT ALL NATIONAL 
OPTION VARIABLES. 



THE INFORMATION IN THE TABLE IS PRESENTED AT THE MOST DETAILED 
LEVEL, WITH SEPARATE INFORMATION FOR EACH PART OF EACH MULTI-PART 
QUESTION. FOR EACH SUCH ITEM, THERE IS ONE LINE OF INTERNATIONAL 
INFORMATION PLUS ONE LINE OF NATIONAL INFORMATION FOR EACH 
COUNTRY DOCUMENTED IN THIS FILE FOR WHICH A NON-STANDARP 
APPLICATION OF THE ITEM WAS MADE. THE NATIONAL LINE WILL BE 
OMITTED IF THE INSTRUMENT CORRESPONDING TO THE ITEM WAS NOT USED 
AT ALL IN THE COUNTRY (SEE SECTION 1 ABOVE), OR IF THE USE WAS 
STANDARD AND WITHOUT SAMPLING. THE NATIONAL LINE IS REQUIRED FOR 
NATIONAL OPTION ITEMS, WHICH ARE IDENTIFIED BY THE LETTER 'Z' 
APPEARING AS THE SECOND LETTER OF THE NAME. 
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INTERNATIONAL LINE 
1 LEVEL 

0 POPULATION 

1 STRATUM (THERE ARE NO INTERNATIONAL ITEMS HERE) 

2 SCHOOL 

3 CLASS (THERE ARE NO INTERNATIONAL ITEMS HERE) 
^ TEACHER 

5 STUDENT 

3-10 VARIABLE NAME FOR THE ITEM. THIS CONTAINS UP TO EIGHT 
CHARACTERS. THE FIRST LETTER INDICATES THE DATA SOURCE, 
AS FOLLOWS... 

P POPULATION IDENTIFICATION 

Q STRATUM INFORMATION (NO INTERNATIONAL ITEMS) 

S SCHOOL QUESTIONNAIRE 

K BEGINNING-OF-YEAR CLASSROOM DATA 

L END-OF-YEAR CLASSROOM DATA 

T TEACHER BACKGROUND QUESTIONNAIRE 

F FRACTIONS TOPIC-SPECIFIC QUESTIONNAIRE 

R RATIO-PROPORTION-PERCENT TOPIC-SPECIFIC QUESTIONNAIRE 

M MEASUREMENT TOPIC-SPECIFIC QUESTIONNAIRE 

G GEOMETRY TOPIC-SPECIFIC QUESTIONNAIRE 

A ALGEBRA TOPIC-SPECIFIC QUESTIONNAIRE 

C CLASSROOM PROCESS GENERAL QUESTIONNAIRE 

X BEGINNING-OF-YEAR STUDENT BACKGROUND AND 

ATTITUDE QUESTIONNAIRE 
Y END-OF-YEAR STUDENT BACKGROUND AND ATTITUDE 
QUESTIONNAIRE 

GENERALLY, THE SECOND, AND POSSIBLY THE THIRD AND FOURTH 
LETTERS, INDICATE BLOCKS OF ITEMS, AND THE LAST LETTER OF 
THE NAME IS USED TO DIFFERENTIATE THE VARIABLES 
CORRESPONDING TO SUBPARTS OF THE SAME QUESTION (E.G., T 
FOR TYPICAL WEEK, L FOR LAST WEEK). WHEN THE SECOND 
LETTER IS • , THE VARIABLE IS A NATIONAL OPTION 
VARIABLE. 

12- 1U LONGITUDINAL INSTRUMENT NUMBER. 

16-18 LONGITUDINAL QUESTION NUMBER. 

20-21 LONGITUDINAL SUBQUESTION NUMBER OR CODE. 

23 CARD (RECORD) NUMBER, FROM THE LONGITUDINAL CODEBOOK. 

25-26 FIRST POSITION (COLUMN) NUMBER, FROM THE LONGITUDINAL 
CODEBOOK. 
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28 WIDTH OF THE DATA FIELD. NOTE THAT IT IS A UNIFORM CONVFNTION 
OF THIS STUDY THAT MISSING DATA IS CODED AS A FIELD FILLED 
WITH 9'S (9, 99, 999, ETC.). ALSO, EXCEPT POSSIBLY FOR NATIONAL 
SAMPLING DATA, ALL DATA ITEMS ARE INTEGERS, RIGHT-JUSTIFIED WITH 
LEFT ZERO FILL. 

FURTHERMORE, IT IS UNDERSTOOD THAT CODE 8 WAS USED IN 
FRANCE FOR 'UNCODABLE' INFORMATION. 

30 ATTITUDE SCALE IDENTIFICATION. 

1 HOME SUPPORT 

2 MATHEMATICS IN SCHOOL 

3 MATHEMATICS AS A PROCESS 
1| MATHEMATICS AND MYSELF 

5 MATHEMATICS ANXIETY 

6 SEX STEREOTYPING 

7 MATHEMATICS AND SOCIETY 

8 COMPUTERS, CALCULATORS, AND MATHS 

32-33 QUESTION NUMBER FOR THE CROSSSECTIONAL VERSION OF THE 
ITEM. MANY LONGITUDINAL ITEMS HAVE NO CROSSSECTIONAL 
COUNTERPARTS. 

35-71* SHORT TITLE FOR THE VARIABLE, SUITABLE FOR PROGRAM LABELS. 



NATICiVAL LINE 



3-4 COUNTRY CODE NUMBER. 

6 ITEM QUALITY. 

0 NOT USED 

1 USED BUT SPOILED 

2 NON-STANDARD CODING AND TEXT 

3 NON-STANDARD CODING 
1* NON-STANDARD TEXT 

5 USED IN STANDARD FORM 
9 NATIONAL OPTION ITEM 

12-80 COMMENTS CONCERNING PROBLEMS W^H QUALITY, REASON FOR 

NON-APPLICATION, NONSTANDARD POSITION, ETC., OR NATURE OF 
NATIONAL OPTION QUESTION. 
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0 PCOUNT 0 0 2 NAME OF THE COUNTRY 

1 QSTRAT 0 0 2 PRINCIPAL STRATIFICATION CODE 

2 SAREA 800 1 1 ?0 1 1 KIND OF COMMUNITY SERVED BY SCHOOL 
15 3 Expanded and reordered coding 

'lO 3 Contracted coding? 

5^ 3 Added code 6 for undecided 

2 SENROLB 800 2 1 1 21 i| 2 BOYS.. TOTAL ENROLMENT IN SCHOOL 

2 SENROLG 800 2 2 \ 2'i k 2 GIRLS.. TOTAL ENROLMENT IN SCHOOL 

2 SAPOPB 800 3 A1 1 29 'I 3 BOYS. .POPULATION A STUDENTS IN SCHOOL 

2 SAPOPG 800 3 A2 1 33 1 3 GIRLS. .POPULATION A STUDENTS IN SCHOOL 

2 SNOMTHB 800 3 HI 1 37 1 3 BOYS.. POP A WHO DO "NOT TAKE MATH 

15 0 Not used, since all take math 

22 0 Not used, since all take math 

10 0 Not used, since all take math 

0 Not used, since all take math 

2 SNOMTHG 800 3 B2 1 ll 4 3 GIRLS.. POP A WHO DO NOT TAKE MATH 

15 0 Not used, since all take math 

22 0 Not used, since all take math 

^0 0 Not used, since all take math 

5^4 0 Not used, since all take math 

2 STCHS 800 i| 1 15 3 M NUMBER OF FULL-TIME TEACHING STAFF 

2 SSOMMM 800 5 1 1 1*8 3 5 MALES. .TEACHING ONE OR MORE MATHS 

2 SSOMMF 800 5 2 1 51 3 5 FEMALES. .TEACHING ONE OR MORE MATHS 

2 SALLMM 800 6 1 1 51* 3 6 MALES. .TEACHING MATH EXCLUSIVELY 

2 SALLMF 800 6 2 1 57 3 6 FEMALES. .TEACHING MATH EXCLUSIVELY 

2 SSPECM 800 7 1 1 60 3 7 MALES. .QUALIFIED MATH. SPECIALISTS 

22 H Defined specialist as math majors or math ed .concentration 

63 ^ Defined specialist form 3 level teachers of math 

2 SSPECF 800 7 2 1 63 3 7 FEMALES. .QUALIFIED MATH SPECIALISTS 

22 4 Defined specialist as math majors or math ed concentration 

63 ^ Defined specialist form 3 level teachers of math 

2 SDAYSYR 800 8 1 66 3 8 OFFICIAL SCHOOL DAYS PER YEAR 

15 1* Not asked, imputed by national centre 

Ho H Not asked, imputed by national centre 

2 SSCHPER 800 9 1 69 2 9 AVERAGE NUMBER OF PERIODS PER SCHOOL DAY 

15 ^ Not asked, imputed by national centre 

5^ 2 Records periods per school week of 5.5 days 

2 SPERLEN 800 10 1 71 3 10 AVERAGE LENGTH OF EACH PERIOD IN MINUTES 

15 1* Not asked, imputed by national centre 

2 SCALSUB 800 1 1 1 71* 1 11 WHICH SUBJECTS CALCULATORS ENCOURAGED 

2 SMEET 800 12 1 75 1 12 FREQUENCY MEETINGS MATHEMATICS TEACHERS 

15 3 Expanded coding with 6=2+3, 7=3+1*, 8=1+2 

5^* 2 Could be per term or per year, question was unclear 

2 SDOWHAT 800 13 1 76 1 13 ACTIVITIES AT THE MATH TEACHER MEETINGS 

15 3 Expanded coding 

HO 3 Contracted coding 

2 SPOLFF 800 11* 1 77 1 POLICY ON FOUR FUNCTION CALCULATOR 

2 SPOlPP 800 15 1 78 1 15 POLICY ON PROGRAMMED CALCULATOR 

2 SSTREAM 800 16 1 79 1 16 SETTING OR STREAMING POP A MATH 

15 3 Modified coding with 3=stream, i*=set, 2=no, 1=both 

22 1* Modified question 
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25 2 
81 3 



Streaming omitted and modified codes, but recoded ok 
Contracted coding? 
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TSEX 

TAGE 

TEXPTCH 

TEXPMTH 

TEDMATH 

15 0 

22 2 

25 2 

TEDMED 

15 0 

22 2 

25 2 

TEDGED 

15 0 

22 2 

25 2 

THRSTCH 

THRSMTH 

TSCITCH 

TOTHTCH 

THOD 

HO 0 

TADGEN 

15 H 

HO 0 

TADSUE 

15 H 

HO 0 

TPOPAC 

81 0 

TPOPAH 

TLOWAC 

81 0 

TLOUAH 

THIGHAC 

81 0 

5H 0 

THIGHAH 

5H 0 

TSBJCTS 

22 3 

5H 3 

TNTCHS 

TNSTUDS 

TPPWEEK 

TLENPER 

THPYEAR 

TCFMATH 

22 2 

TRANGE 

TMASTRY 

TMTHSUB 



600 
600 
600 
600 
600 



1 

2 

3 

n 

5 



1 YOUR SEX 



YOUR AGE IN YEARS 
YEARS OF EXPERIENCE AS A TEACHER 
YEARS TEACHING MATHEMATICS TO POP A 



5 SEMESTERS POSTSECONDARY MATHEMATICS 
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1 20 1 
1 21 2 
1 23 2 
1 25 2 
1 27 2 
Not used 

Asked how many courses 
Multichoice format recoded ok 

600 6 1 29 2 6 SEMESTERS POSTSECONDARY MATH PEDAGOGY 
Not used 

Asked how many courses 
Multichoice format recoded ok 

600 7 1 31 2 7' SEMESTERS POSTSECONDARY GENERAL PEDAGOGY 
Not used 

Asked how many courses 
Multichoice format recoded ok 

600 8 1 33 2 8 TOTAL NUMBER OF TEACHING PERIODS 

600 9 1 35 2 9 PERIODS PER WEEK TEACHING MATHEMATICS 

600 10 A 1 37 1 10 ALSO TEACHER OF SCIENCE 

600 10 B 1 38 1 10 ALSO TEACHER IN OTHER AREAS 

600 10 C 1 39 1 10 ALSO HEAD OF THE MATHEMATICS DEPARTMENT 

Not used, inadequate 

600 10 D 1 HO 1 10 ALSO SCHOOL ADMINISTRATOR GENERAL 
Asked about class administrator 
Not used 

600 10 E 1 HI 1 10 ALSO SCHOOL ADMINISTRATOR SUBJECT AREA 
Asked about other duties 
Not used 
600 



600 
600 
Not 
600 
600 



600 
Not used 
600 12 



11 A1 


1 


H2 


1 


11 


CLASSES.. POPULATION A 


used? 












11 A2 


1 


H3 


2 


11 


HOURS.. POPULATION A 


11 B1 


1 


H5 


1 


11 


CLASSES.. LOWER THAN POPULATION A 


used? 












11 B2 


1 


H6 


2 


11 


HOURS.. LOWER THAN POPULATION A 


11 CI 


1 


H8 


1 


11 


CLASSES.. HIGHER THAN POPULATION A 


used? 












used 












11 C2 


1 


H9 


2 


11 


HOURS. .HIGHER THAN POPULATION A 



1511 12 HOW MANY SUBJECTS TO THE TARGET CLASS 



Codes reversed, recoded ok 



600 


13 


1 


52 


1 


13 OTHER TEACHERS MATH TO TARGET CLASS 


600 


1H 


1 


53 


2 


1H STUDENTS ENROLLED IN THE TARGET CLASS 


600 


15 


1 


55 


2 


15 PERIODS OF MATH INSTRUCTION EACH WEEK 


600 


16 


1 


57 


3 


16 AVERAGE LENGTH OF CLASS PERIOD MINUTES 


600 


17 


1 


60 


3 


17 HOURS OF MATH INSTRUCTION BY END OF YEAR 


600 


18 


1 63 


1 


18 TARGET CLASS COMPARED WITH OTHER CLASSES 


Did 


not 


include 


no 


other classes alternative, recp^es ok? 


600 


19 


1 


6H 


1 


19 RANGE OF MATHEMATICS ABILITIES CLASS 


600 


20 


1 


65 


3 


20 MASTERY OF PREVIOUS CURRICULUM 


600 


21 


1 


68 


1 


21 CHARACTER OF MAIN MATH SUBJECT MATTER 
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5 YMTHRUL 520 3 6ll 1 3 1*3 MATHEMATICS IS A SET OF RULES 

5 YNOUSE 520 85 3 65 1 7 70 MOST PEOPLE DONT USE MATH IN THEIR JOBS 

25 l» Referred to arithmetic rather than mathematics 

5 YESTIMP 520 86 3 66 1 3 36 ESTIMATING IS AN IMPORTANT MATH SKILL 

5 YMNYWYS 520 87 3 67 1 3 37 MANY HAYS TO SOLVE MOST MATH PROBLEMS 

5 YCALM 520 88 3 68 1 5 62 I USUALLY FEEL CALM WHEN DOING MATH 

5 YCALHLP 520 89 3 69 1 8 79 CALCULATOR CAN HELP YOU LEARN MATH TOPIC 

25 1* Question was, Computer make learning math more enjoyable 

5 YBOYSND 520 90 3 70 1 6 67 BOYS NEED MORE MATHEMATICS THAN GIRLS 

5 YNOMORE 520 91 3 71 1 53 IF CHOICE I HOULDNT LEARN ANY MORE MATH 

5 YNEWDSC 520 92 3 72 1 3 31* NEW DISCOVERIES IN MATH ARE BEING MADE 

25 0 Not used 

5 YDIFWAY 520 93 3 73 1 3 1*1* MATH CAN BE SOLVED IN DIFFERENT WAYS 

25 0 Not used 

///////////////////////////////////////////////////////////////// 
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$ type document :a. 5 



SECTION 5 

SAMPLING NOTES AND STRATUM DEFINITIONS 



THIS SECTION CONTAINS SPECIAL INFORMATION ON EACH COUNTRY'S 
SAMPLE DESIGN. THIS IS NEEDED TO CALCULATE OR APPLY SAMPLING 
WEIGHTS, EVALUATE SAMPLING ERROR THROUGH FXAMINATION '^F DESIGN 
EFFECTS OR ANALYSIS OF REPLICATE SUBSAMPLES, AND TO IDENTIFY 
NATIONAL SUBPOPULATIONS OF IMPORTANCE FOR ANALYSIS AND 
INTERPRETATION. THE INFORMATION IS TAKEN FROM THE WELLINGTON 
SAMPLING ANALYSIS AND REPORT. 



EXACT DEFINITION OF EACH STRATUM 
STRATUM POPULATION SIZES 
SAMPLING METHOD WITHIN STRATUM 
SAMPLING METHOD FOR CLASSES AND STUDENTS 
WITHIN SCHOOLS 

SAMPLING WEIGHTS FOR STRATA AND SCHOOLS 
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POPULATION DEFINITION: ALL STUDENTS IN THE SECOND YEAR OF THE 

GENERAL SECONDARY EDUCATION, TECHNICAL 
SECONDARY EDUCATION AK'D VOCATIONAL 
SECONDARY EDUCATION PROGRAMMES IN B07H 
TYPE I AND TYPE II FORMS OF SCHOOL 
ORGANISATION. 

EXCLUDED POPULATION: STUDENTS IN PROVINCIAL 'GENERAL AND 

TECHNICAL* AND 'GENERAL' SCHOOLS. 

STRATA: INITIAL STRATIFICATION VARIABLES: 

ORGANISING AUTHORITY 
COURSE TYPE 

LIST OF (NATIONAL CENTRE) STRATA: 

1) ORGANISING AUTHORITY: CATHOLIC 

GENERAL AND TECHNICAL (COMPREHENSIVE) SCHOOL, TYPE I 
(NON-TRADITIONAL) 

2) ORGANISING AUTHORITY: CATHOLIC 
GENERAL SCHOOL, TYPE II (TRADITIONAL) 

3) ORGANISING AUTHORITY: CATHOLIC 
TECHNICAL SCHOOL, TYK II 

H) ORGANISING AUTHORITY: CATHOLIC 
VOCATIONAL SCHOOLS, TYPE I AND II 

5) ORGANISING AUTHORITY: STATE 

GENERAL AND TECHNICAL (COMPHEHP.NSIVE) SCHOOL, "TYPE I 

6) ORGANISING AUTHORITY: STATE 
GENERAL SCHOOL, TYPE II 

NO SCHOOLS IN THIS STRATUM, 

7) ORGANISING AUTHORITY: STATE 
TECHNICAL SCHOOL, TYPE II 

NO SCHOOLS IN THIS STRATUM 

8) ORGANISING AUTHORITY: STATE 
VOCATIONAL SCHOOLS, TYPE I, 

9) ORGANISING AUTHORITY: PROVINCIAL 
GENERAL AND TECNICAL, TYPE I 

NO SAMPLE SCHOOLS 
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10) ORGANISING AUTHORITY: PROVINCIAL 
GENERAL,- TYPE II 

NO SAMPLE SCHOOLS 

11) ORGANISING AUTHORITY: PROVINCIAL 
TECHNICAL, TYPE II. 

12) ORGANISING AUTHORITY: PROVINCIAL 
VOCATIONAL SCHOOLS, TYPES I AND II 

13) ORGANISING AUTHORITY: COMMUNAL 
GENERAL AND TECHNICAL, TYPE I. 

1H) ORGANISING AUTHORITY: COMMUNAL 
GENERAL, TYPE II. 

15) ORGANISING AUTHORITY: COMMUNAL 
TECHNICAL, TYPE II. 

16) ORGANISING AUTHORITY: COMMUNAL 
VOCATIONAL, TYPE I AND TYPE II. 

THESE STRATA WERE COLF.APSED AT THE INTERNATIONAL CENTRE FOR TWO 
REASONS. FIRST, THE NATIONAL CENTRE ADVISED THAT DURING THE 
COURSE OF THE STUDY THE BALANCE BETWEEN TYPE I AND TYPE II 
COURSES CHANGED VERY RAPIDLY AND, SECOND, SOME STRATA CONTAINED 
INSUFFICIENT SCHOOLS TO ALLOW RELIABLE WEIGHTING. 

THE NEW STRATA FORMED WERE AS FOLLOWS: 

STRATUM 1 : 1*2 ABOVE 

STRATUM 2 : 3 * ^ ABOVE 

STRATUM 3 : 13 ♦ I** ABOVE 

STRATUM 1| : 11 ♦ 12 ♦ 15 ♦ 16 ABOVE 

STRATU.M 5 : 5 ABOVE 

STRATUM 6 : 8 ABOVE 

THUS THE STRATA FOR WEIGHTING CONSISf OF : 

1) CATHOLIC 'GENERAL AND TECHNICAL' AND 'GENERAL' SCHOOLS 

2) CATHOLIC 'TECHNICAL' AND 'VOCATIONAL' SCHOOLS 

3) COMMUNAL 'GENERAL AND TECHNICAL' AND 'GENERAL' SCHOOLS 
H) PROVINCIAL AND COMMUNAL 'TECHNICAL' AND 'VOCATIONAL' 

SCHOOLS 

5) STATE 'GENERAL AND TECHNICAL' SCHOOLS 

6) STATE 'VOCATIONAL' SCHOOLS 
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SCHOOLS SELECTED WITH PROBABILITY PROPORTIONAL TO SIZE OF TARGET 
GRADE USING RANDOM START, CONSTANT INTERVAL. 

ONE CLASS RANDOMLY SELECTED WITHIN SCHOOL. 

WEIGHTS CALCULATED: 

STRATUM WZIGHTS W1 = (M/N)«(NI/MI ) 

W2 = {M/N)«(NI/(SI»NIJ)) 

M = TOTAL KUMBER OF STUDENTS IN THE ACHIEVED SAMPLE. 
N s TOTAL NUMBER OF STUDENTS IN THE POPULATION 
NI = NUMBER OF STUDENTS IN THE POPULATION IN STRATUM I. 
MI = ^^JMBER OF STUDENTS IN THE ACHIEVED SAMPLE IN STRATUM I. 
SI = NUMBER OF SCHOOLS IN THE ACHIEVED SAMPLE IN STRATUM I. 
NIJ = NUMBER OF STUDENTS IN THE ACHIEVED SAMPLE FOR SCHOOL J OF 
STRATUM I. 

NOTE: FURTHER NOTES RE LOSS OF SOME TEACHER INFORMATION FROM 
SAMPLE TO BE ADDED. 



WEIGHTING - BELGIUM(FLEMISH) - POP A 



M=3103 
N=88758 



COL 1 s ORIGINAL STRATUM 

COL 2 : ORIGINAL SCHOOL NUMBER 

COL 3 s NEW STRATUM 

COL H s NEW SCHOOL NUMBER 

COL 5 s CLASS NUMBER 

COL 6 = ACHIEVED SAMPLE 

COL 7 = STRATUM WEIGHT (W1) 

COL 8 « SCHOOL/CLASS WEIGHT {W2) 



Ml s ACHIEVED 'SAMPLE OF 

STUDENTS IN STRATUM 1 



NI = POPULATION OF STRATUM 1. 
I.r. STRATUM 1 SUB-POPU- 
LATION 
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2 


3 
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5 


6 


7 


8 








M1:1291 














N1:32291 








01 


003 


01 


103 


01 


022 


0.874 


f\ Or* r* 

0.855 


01 


005 


01 


105 


01 


018 


0.874 


4 f\\\ f 
1 .045 


01 


006 


01 


106 


01 


014 


0.874 


1 .344 


01 


007 


01 


107 


01 


027 


0.874 


0.697 


01 


008 


01 


108 


01 


021 


0.874 


0.696 


02 


001 


01 


201 


01 


024 


0.874 


A\ ^ D ll 

0.784 


02 


002 


01 


202 


01 


017 


0.874 


1 . 107 


02 


OOU 


01 


204 


01 


027 


0.874 


0.697 


02 


005 


01 


205 


01 


016 


0.874 


4 4 T £ 

1 . 170 


02 


006 


01 


206 


01 


026 


0.874 


A T^ ll 

0.724 


02 


007 


01 


207 


01 


024 


0.874 


A tO ll 

0.7o4 


02 


008 


01 


208 


01 


026 


0.874 


A ll 

0.724 


02 


009 


01 


209 


01 


Ol8 


0.874 


4 All C 

1 .045 


02 


010 


01 


210 


01 


006 


0.874 


3.130 


02 


Oil 


01 


211 


01 


024 


0.874 


A TD ll 

0.7o4 


02 


012 


01 


212 


01 


026 


0.874 


A T ^ ll 

0.724 


02 


013 


01 


213 


01 


024 


0.874 


A TD ll 

0.784 


02 


015 


01 


215 


01 


021 


0.074 


0.090 


02 


016 


01 


216 


01 


027 


0.874 


A £. AT 
0.097 


02 


017 


01 


217 


01 


01 1 


0.874 


1 .7IU 


02 


018 


01 


218 


01 


018 


0.874 


4 A ll f 

1.045 


02 


019 


01 


219 


01 


027 


0.874 


A £ At 

0.697 


02 
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SECTION 6 

DETAILED CODING AND TEXTUAL EXPLANATIONS 



IN THIS SECTION IS GIVEN THE FULL TEXT OF ALL QUESTIONS IN ALL 
QUESTIONNAIRES AfJD OTHER DATA SOURCES, TOGETHER WITH THE FULL TEXTS 
OF THE RESPONSE ALTERNATIVES, THEIR NUMERIC CODES, AND 
ABBREVIATED ( 16-CHARACTER) VERSIONS SUITABLE FOR STATISTICAL 
PROGRAM LABELS. SOME OF THE INTERNATIONAL STANDARD INSTRUCTIONS 
TO THE RESPONDENTS FOR GROUPS OF QUESTIONS (E.G., ATTITUDE SCALES) 
ARE ALSO GIVEN. 

IN ADDITION TO THE INTERNATIONAL STANDARD INFORMATION, 
WHICH CORRESPONDS MORE OR LESS TO THE INTERNATIONAL CODEBOOKS, 
DEFINITIONS ARE GIVEN OF THE TEXTS AND RESPONSE CODINGS OF NATIONAL 
OPTION VARIABLES, AND NOTES OH NATIONAL EXCEPTIONS AND VARIATIONS 
FROM INTERNATIONAL FORMS ARE PRESENTED. THIS IS DONE IN SUCH A 
WAY THAT A CODEBOOK SPECIFIC TO A NATIONAL STUDY CAN BE' DERIVED. 

CONCERNING THE COGNITIVE ITEMS, THIS SECTION CONTAINS 
THE FORMS FOR ELICITING THE OTL AND CALCULATOR QUESTIONS, AND 
THE FULL TEXTS OF THE NATIONAL OPTION COGNITIVE ITEMS (BUT 
NOT THE INTERNATIONAL COGNITIVE ITEMS). 
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POPULATION VARIABLES 



9 POPULATION VARIABLES. 

PCOUN'T COUNTRY . 

/10 ARGENTINA 

/II AUSTRALIA 

/15 BELGIUM FLEMISH 

/16 BELGIUM FRENCH 

/20 BRAZIL 

/21 CANADA ALBERTA 

/22 CANADA BRITISH COLUMBIA sCANADA B C 
/23 CANADA MANITOBA 

/2M CANADA NEWFOUNDLAND AND LABRADOR =CANADA NWFL LAB 

/25 CANADA ONTARIO 

/26 QUEBEC 

/27 CHILE 

/SO COLOMBIA 

/31 COSTA RICA 

/3^ DOMINICAN REPUBLIC =DOM REPUBLIC 
/35 ECUADOR 
/37 ENGLAND 
/39 FINLAND 
/HO FRANCE 

/Ml GERMANY FEDERAL REPUBLIC :=GERMANY FR 

/i>3 HONG KONG 

/UU HUNGARY 

/U5 INDIA 

/i(6 INDONESIA 

/HI IRAN 

/i>9 IRISH REPUBLIC 

/50 ISRAEL 

/51 ITALY 

/52 IVORY COAST 

/5M JAPAN 

/57 KOREA SOUTH 

/59 LUXEMBOURG 

/61 MEXICO 

/62 NETHERLANDS 

/63 NEW ZEALAND 

/64 NIGERIA 

/68 POLAND 

/70 PUERTO RICO 

/72 SCOTLAND 

/IH SPAIN 

/75 SWAZILAND 

/76 SWEDEN 

/79 THAILAND 

/81 USA 

/82 VENEZUELA 
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STRATUM VARIABLES 



9 STRATUM VARIABLES. 

•SLEVEL (»NATION-SPECIFIC») 

QSTRAT PRINCIPAL STRATIFICATION CODE. "SLlVEL 



SCHOOL QUESTIONNAIRE 



(♦22 BRITISH COLUMBIA MADE SEVERAL MINOR CHANGES TO THE INTRODUCTI ION 
SO THAT THE QUESTIONNAIRE WAS MORE RELEVANT TO THE B C SITUATION*) 
9 SCHOOL QUESTIONNAIRE 

7 SECTION A - TO BE COMPLETED BY SCHOOL PRINCIPAL 

SAREA WHICH OF THE FOLLOWING BEST CHARACTERIZES THE COMMUNITY ERVED 

YOUR SCHOOL? 

/I RURAL 

12 SUBURBAN 

/3 URBAN 

1^ URBAN-SUBURBAN =URBAN SUBURBAN 

/5 INNER CITY METROPOLIS (I.E., FOR CITIES WITH A TOTAL 
POPULATION GREATER THAN HALF A MILLION) =INNER CITY METRO 
(♦15 BELGIUM(FL) CHANGED TO: 
/I URBAN 
12 SUBURBAN 
/3 RURAL 

/I URBAN ♦ SUBURBAN 
/5 URBAN ♦ RURAL 
/6 SUBURBAN ♦ RURAL 
/7 URBAN ♦ SUBURBAN ♦ RURAL 
RECODED ON TABLES: /I =3 

II 1 

/5 = 3 

/6 = 2 

II = 

(♦5^ JAPAN ADDED CODE 6 - UNDECIDED*) 

2 WHAT IS THE TOTAL ENROLMENT OF FULL-TIME (OR FULL-TIME 

EQUIVALENT) SECONDARY STUDENTS IN YOUR SCHOOL? 
SENROLB BOYS 
SENROLG GIRLS 

2 WHAT IS THE NUMBER OF POPULATION A STUDENTS IN YOUR SCHOOL? 

(♦22 BRITISH COLUMBIA CHANGED "POPULATION A" TO "GRADE 8" FOR ALL 
PARTS OF THIS QUESTION*) 
SAPOPB BOYS 
SAPOPG GIRLS 

2 WHAT IS THE NUMBER OF POPULATION A STUDENTS WHO DO NOT TAKE A 

MATHEMATICS COURSE IN YOUR SCHOOL? 
SNOMTHB BOYS 

(♦40 FRANCE DELETED THIS VARIABLE, WITH THE COMMENT THAT ALL POP A 
STUDENTS TAKE MATHEMATICS*) 

(-54 JAPAN DELETED: 99/t CODED 0; ONE SCHOOL APPARENTLY HAS 320 BOYS 
NOT TAKING MATHEMATICS. THIS COULD BE A CODING ERROR.-) 
(-54 JAPAN CODED 999 BUT PROBABLY MEANT TO BE "0". RECORDED ON TABLE 
AS SUCH-) 
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YHAPPy WORKING WITH NUMBERS MAKES ME HAPPY. "AGREE 

ySCARED IT SCARES ME TO HAVE TO TAKE MATHEMATICS. "AGREE 

YCALM I USUALLY FEEL CALM WHEN DOING .MATHEMATICS PROBLEMS. "AGREE 

YFUN I THINK MATHEMATICS IS FUN. "AGREE 

YINMAZE WHEN I CANNOT FIGURE OUT A PROBLEM, I FEEL AS THOUGH I AM LOST 

A MAZE AND CANNOT FIND MY WAY OUT. "AGREE 
YMENBET MEN MAKE BEHER SCIENTISTS AND ENGINEERS THAN WOMEN. "AGREE 
YBOYSAB BOYS HAVE MORE NATURAL ABILITY IN MATHEMATICS THAN GIRLS. "AGREE 
YBOYSND BOYS NEED TO KNOW MORE MATHEMATICS THAN GIRLS. "AGREE 
YUOMCAR A WOMAN NEEDS A CAREER JUST AS MUCH AS A MAN DOES. "AGREE 
YMTHJOB IT IS IMPORTANT TO KNOW MATHEMATICS IN ORDER TO GET A GOOD JOB 

"AGREE 

(-15 BELGIUM(FL) DELETED THIS QUESTION-) 

YNOUSE MOST PEOPLE DO NOT USE MATHEMATICS IN THEIR JOBS. "AGREE 
YJOBUSE I WOULD LIKE TO WORK AT A JOB THAT LETS ME USE MATHEMATICS. 
"AGREE 

YUSEDAY MATHEMATICS IS USEFUL IN SOLVING EVERYDAY PROBLEMS. "AGREE 
YGOWO I CAN GET ALONG WELL IN EVERYDAY LIFE WITHOUT USING MATHEMATICC 
■ "AGREE 

YPRACT MOST OF MATHEMATICS HAS PRACTICAL USE ON THE JOB. "AGREE 
YNONEED MATHEMATICS IS NOT NEEDED IN EVERY DAY LIVING. "AGREE 
YNOTNEC A KNOWLEDGE OF MATHEMATICS IS NOT NECESSARY IN MOST OCCUPATION 
"AGREE 

YLSSFUN IT IS LESS FUN TO LEARN MATHEMATICAL IDEAS IF YOU USE A HAND-HELD 

CALCULATOR. "AGREE 
(♦25 ONTARIO CHANGED TO: "COMPUTERS CAN THINK%) 

i'KOCOMP IF YOU USE A HAND-HELD CALCULATOR YOU DO NOT HAVE TO LEARN TO 
COMPUTE. "AGREE 

(♦25 ONTARIO CHANGED TO: "SOMEDAY COMPUTERS WILL RUN EVERYTHING"*) 
YCALHLP USING A HAND-HELD CALCULATOR CAN HELP YOU LEARN MANY DIFFERENT 

MATHEMATICAL TOPICS. "AGREE 
(♦25 ONTARIO CHANGED TO: "COMPUTERS MAKE LEARNING MATHEMATICS MORE 
ENJOYABLE"*) 

YFUNCAL SOLVING WOFiD PROBLEMS IS MORE FUN IF YOU USE A HAND-HELD 

CALCULATOR. "AGREE 
(♦25 ONTARIO CHANGED TO: "EVERYONE SHOULD LEARN ABOUT COMPUTERS"*) 
YCMPSLV COMPUTERS SOLVE PROBLEMS BEHER THAN PEOPLE DO. "AGREE 
(♦25 ONTARIO CHANGED TO: "USING A HAND CALCULATOR MAKES IT MORE 
FUN TO SOLVE PROBLEMS IN MATHEMATICS"*) 

YBORING USING COMPUTERS MAKES LEARNING MATHEMATICS MORE MECHANICAL AND 
BORING. "AGREE 

(♦25 ONTARIO CHANGED TO: "MATHEMATICAL IDEAS CAN BE LEARNED FASTER 
IF YOU USE A HAND CALCULATOR"* ) 

YALLCMP EVERYONE SHOULD LEARN SOMETHING ABOUT COMPUTERS. "AGREE 
(♦25 ONTARIO CHANGED TO: " IF YOU USE A HAND CALCULATOR YOU DO 
NOT HAVE TO LEARN HOW TO COMPUTE"*) 

YCOMPOK COMPUTERS DO LOTS OF GOOD THINGS FOR PEOPLE. "AGREE 
(♦25 ONTARIO CHANGED TO: "USING A HAND CALCULATOR CAN HELP YOU 
LEARN MANY DIFFERENT MATHEMATICAL TOPICS"^) 



• • • 

9 END OF FILE 

///////////////////////////////////////////////////////////////// 
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Appendix V, Weighting, Samplinc* Errors, and Non- 
sampling Errrrs 



This appendix is reprinted from Sampling Report for the Second 
lEA Mathematics Study by Robert A. Garden, New Zealand Department 
of Education. 
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9, Weighting 



Although the recommended sampling method was designed to 
give self-weighting samples, data from all systems, with 
the exception of Swaziland population A and Scotland 
Population A, have had weights applied in the computation 
of cognitive statistics. For many systems this made 
little difference to subscores and p-values but other 
systems for which differential response rates across 
strata were obtained or in which some small strata were 
over-sampled weighting was clearly necessary* 

Swaziland and Scotland Population A samples were not 
stratified. 

Almost all countries sampled intact classes because a 
principal aim of the study was to detect teacher effects* 
For between-class analyses for this purpose weighting of 
cognitive data is of doubtful value. 

Teacher Opportunity-to-Learn data was also weighted. 

The effect of weighting on other teacher variables and on 
student background variables was found to be negligible. 

9.1 Weights for Cognitive Data 

Weights calculated for estimates of national parameters of 
student cognitive sub-scores and p-values depended for 
each sample on the sampling unit, the amount of variation 
in cluster (school or class) sizes and various other 
factors. 



9.1,1 stratum Weights 



These were calculated for all samples using the formula 



n N 

Wi = . 

N n: 



i 



where Wj^ is the weight for stratum i 

n is the total sample size 

N is the total population size 

nj^ is the stratum i sample size 

and Nj^ is the stratum i population size. 

Stratum weights were used to weight England and Wales 
data. In England and Wales students (not classes) were 
sampled within school and this, coupled with the loss of 
data at the data preparation stage, gave a large variation 
in (school) cluster size. 



Stratum weights gave p-values and sub-score means which 
were more stable than obtained using school weights. 
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9,1.2 



School Weights 



School weights were calculated where sampling was by 
schools and where the variance of class size within school 
was substantial. The formula used was: 

n 

w. j = . 

N SiNij 

where Wj^^ is the weight for school j In stratum 1 

Sj^"^ is the nvunber of schools In the sample for 
stratum 1 

Nj^^ Is the number of students in the sample in 
school j In stratum i. 
n, N and Nj^ are as in 9. 1.1 

Systems for which school weights were applied are: 

Belgium (F7emlsh) Populations A and B, Belgium (French) 
AB, British Columbia A, England and Wales B, France A, 
Israel A, Japan AB, New Zealand AB, Ontario AB, Scotland 
B, Thailand AB, U.S.A. AB. 

Note ; where only one class per school v;as chosen the 
terms school weight and class weight are 
synonymous . 

9.1.3 Class weights 

Where sampling was by classes the weights wero calculated 
by the formula in 9.1.2 but with s^ ^ number of classes in 
the stratum i sample and n^^ = number of students in the 
sample in class j of stratum i. 

Samples for which class weights were calculated are: 

Hong Kong AB, Hungary AB, Luxembourg A, British Columbia 
B, Finland AB, Israel B, Sweden AB. 

Note ; where only one class per school was chosen the 
terms school weight and class weight are synonymous, 

9.1.4 Weighted p-values and Subscores 

i) At school or class level (depending on the sampling 
method) the number of students responding correctly 
to an item was counted (and school or class level 
p-values obtained) . 
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ii) National estimates of p-values vere computed using 



Where Pj^j and Wj^j are the p-values and weights 
for school/class j in stratum i. 

Wj^j used in this way is an estimate for the weight 
wnich would be obtained if the number of schools or 
classes in the population and in each stratum were 
known. 2 Wj^j will be approximately equal to the 
number of schools/classes in the sample. 

iii) Weighted p-values were summed across sub-test items 
to give sub-test means. 

It should be noted that for many countries there was 
little difference (1 or 2 percent) between unweighted and 
weighted p-values and sub-test means. In addition, use of 
school/class weights gave very similar results to the use 
of stratiim weights. 

Calculation of p-values using £ Xj^jWj^j 

where Xj^j is the sum of correct responses to an item and 
nj^j is tne number of students in school/class j of stratum 
i also produced very similar results at subtest level, 
although non-systematic differences of several points were 
evident for some items f a few samples. Differences 
can be expected where cluster sizes vary considerably and 
class response patterns are very different. 
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9.1.5 Weighting Teacher Opportunity-to-learn 



The calculated stratum weights were used to weight teacher 
OTL. 

n Nj^ 
w. . . 

N 

where Wj.; • weight for teacher j in stratum i. 

n = total number of students in the sample. 
N = total number of students in the population, 
nj^ = number of students in the stratum i sample. 
Nj^ = number of students in the stratum i 
population. 

^ "c ^ "t 



and 



^ N^i ^ 
"i ^ci Nti 



Where the "c" ratios are school/class ratios and the "t" 
ratios are teacher ratios. 
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10. Sampling Errors 



Standard errors have been calculated for cognitive forms 
Core and A at population A level and forms 1 and 7 at 
population B level and these are displayed in the tables 
below. The standard errors are, in general, stable across 
forms for both populations and will be representative of 
the error levels for subscores. 

Intraclass correlations, and consequently Design Effects, 
were considerably higher than was anticipated. In spite 
of this errors for almost all countries lie within 
acceptable limits. 



The high intraclass correlation coefficients (Rho) result 
from several factors: 

i) Intact mathematics classes were sampled; 

ii) The widespread practice of streaming/setting laathe- 
matics classes results in a considerable reduction 
in within class hetergeneity; 

iii) Sampling systems with differing school types, or 

wide course variations in curricula between school/ 
course types leads to relatively greater degree of 
within school/class hemogeneity. 

iv) Learning in mathematics is probably sensitive to 
curricular and instructional differences than is 
learning in most other school subjects. 

Thus population A intraclass correlation coefficients are 
high in Belgium, Hong Kong, Luxembourg, The Netherlands 
(differing school types) in Finland, Sweden and the USA 
(differing course types) and in New Zealand (a high level 
of streaming) . 

In some countries a combination of these factors applies. 
Lowest intraclass correlations occurred in Japan where the 
school system is al^^^st uniform and where streaming/setting 
of classes is not practised. 

Low intraclass correlations also occur where the tests 
were too difficult for a large majority of the samples 
(Nigeria and Swaziland) so that between class variance is 
considerabl2' depres£>ed. 

Standard errors for Scotland population A were calculated 
by a jack-knif f ing procedure since a relatively small 
sample was spread across a great number of schools. 
Sampling was not by selection of schools or classes so 
calculation of design effects is inappropriate. 
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For populat^.on B the intraclass correlation coefficient is 
affected by the factors mentioned above but, in addition, 
the retentivity of the school system has a marked effect. 
In school systems in which retention in grade 12 mathematics 
is low, between-class variance in likely to be j.dw, as is 
within-class variance and the relative changes with 
respect to these are not easy to predict* 

For rotated forms the clusters completing a given form 
have been treated as though they were complete "school/ 
classes" although they were, in effect, random selections 
of students within school/classes. The st=indard errors 
for rotated forms are therefore conservative. Futhermore, 
sampling fractions for some countries were sufficiently 
large to justify adjusting the variance by a ractor (1-a/A) 
where 'a' clusters are selected from a population of 'A' 
clusters. The extreme case is Luxembourg where a/A = 1/2. 
Thus for Luxembourg (for example) the sampling error for 
the mean will be considerably less than is shown in the 
tables. 
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